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Why  GAO  Did  This  Study 

As  the  military  draws  down  its  forces, 
many  veterans  will  enter  the  civilian 
workforce  and  may  seek  educational 
and  training  opportunities  to  further 
their  transition  into  civilian  jobs. 
Because  pursuing  a  higher  education 
degree  may  not  be  the  best  path  for 
some  veterans,  the  Post-9/1 1  Gl  Bill 
OJT  and  apprenticeship  programs 
provide  alternative  opportunities.  GAO 
was  asked  to  review  these  programs. 

This  report  examines  (1)  how  selected 
veterans  and  employers  used  the 
programs  and  how  widely  they  have 
been  used;  (2)  to  what  extent  VA  and 
states  have  taken  steps  to  inform 
veterans  and  employers  about  these 
programs;  (3)  what  challenges,  if  any, 
veterans  and  employers  have  faced  in 
using  them;  and  (4)  to  what  extent  VA 
has  assessed  the  performance  of  its 
programs.  GAO  analyzed  VA  program 
data  as  of  March  2015  and  DOL 
program  data  from  2013  and  2014,  and 
assessed  outreach  materials.  GAO 
also  surveyed  officials  in  all  44  states 
overseeing  VA’s  programs;  conducted 
nongeneralizable  surveys  of  randomly 
selected  veterans  and  employers;  and 
interviewed  veterans  and  employers  in 
two  states  selected  for  variation  in 
veteran  population  and  type  of  state 
agency. 

What  GAO  Recommends 

GAO  recommends  that  VA  improve 
outreach,  ease  administrative 
challenges,  and  establish  outcome 
measures  for  its  OJT  and 
apprenticeship  programs.  VA  agreed 
with  GAO’s  conclusions  and  concurred 
with  all  three  recommendations. 


View  GAO-16-51.  For  more  information, 
contact  Andrew  Sherrill  at  (202)  512-7215  or 

sherrilla@gao.gov. 
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Apprenticeship  Programs 


What  GAO  Found 

Veterans  surveyed  and  interviewed  by  GAO  said  the  on-the-job  training  (OJT) 
and  apprenticeship  programs  offered  under  the  Post-9/11  Gl  Bill — the  largest 
education  benefit  program  overseen  by  the  Department  of  Veterans  Affairs 
(VA) — have  helped  them  transition  to  civilian  life,  though  program  data  show 
relatively  few  veterans  have  participated.  Post-9/11  Gl  Bill  benefits  were  initially 
available  only  for  higher  education,  but  in  2011  provisions  were  enacted  that 
expanded  benefits  to  cover  OJT  and  apprenticeship.  Many  veterans  GAO 
interviewed  (21  of  28)  said  that  the  supplemental  income  the  programs  provided 
helped  them  offset  income  losses  they  experienced  when  leaving  the  military. 
About  half  of  the  veterans  responding  to  GAO’s  survey  (80  of  156)  reported  that 
the  program  allowed  them  to  use  their  Gl  Bill  benefits  even  though  college  was 
not  a  good  fit  for  them.  Since  OJT  and  apprenticeship  benefits  became  available 
in  201 1 ,  about  27,000  of  the  1 .2  million  veterans  who  have  received  Post-9/1 1  Gl 
Bill  benefits  have  participated  in  these  programs. 

VA  primarily  provides  information  about  the  OJT  and  apprenticeship  programs 
through  mandatory  briefings  for  transitioning  servicemembers  and  on  its  website. 
While  VA’s  outreach  efforts  include  some  information  on  these  programs,  VA’s 
mandatory  briefings  and  web  resources  generally  emphasize  higher  education 
and  lack  sufficient  detail  for  veterans  to  reasonably  understand  how  to  use  their 
Gl  Bill  benefits  for  OJT  and  apprenticeships.  State  officials  GAO  surveyed 
reported  conducting  outreach  in  a  variety  of  ways,  such  as  attending  job  fairs  and 
speaking  to  veterans  groups.  Without  more  outreach,  veterans  who  could  benefit 
from  these  programs  may  not  learn  about  them. 

Key  challenges  faced  by  veterans  and  employers  using  these  programs  include 
lack  of  awareness  and  administrative  burdens,  according  to  state  officials, 
veterans,  and  employers  GAO  surveyed.  Most  state  officials  surveyed  (39  of  44) 
reported  that  lack  of  awareness  about  the  programs  is  a  primary  challenge  they 
face  in  facilitating  veteran  and  employer  participation.  Further,  over  half  of  state 
officials  surveyed  (24  of  42)  cited  challenges  related  to  VA’s  current  paper-based 
payment  processing  system,  which  requires  employers  to  fax  or  mail  monthly 
forms  to  VA  in  order  for  a  veteran  to  receive  benefits.  In  addition,  1 1  of  the  15 
employers  and  apprenticeship  sponsors  GAO  interviewed  said  the  process  is 
burdensome  or  inefficient,  and  6  of  the  28  veterans  GAO  interviewed  said  their 
benefits  have  sometimes  been  delayed.  VA  is  developing  a  new  data  system,  but 
it  may  not  be  implemented  until  2017  at  the  earliest,  according  to  VA  officials, 
and  administrative  challenges  in  the  interim  could  hinder  program  participation. 

Little  is  known  about  the  performance  of  VA’s  Post-9/11  Gl  Bill  OJT  and 
apprenticeship  programs  because  VA  does  not  measure  program  outcomes, 
such  as  whether  participants  retain  employment  after  completing  the  program. 
Absent  such  information,  GAO  examined  Department  of  Labor  (DOL)  outcome 
data  for  its  related  OJT  and  apprenticeship  programs,  which  indicate  the  potential 
for  positive  outcomes  for  these  training  models.  Standards  for  internal  control  call 
for  establishing  and  reviewing  performance  measures  to  allow  an  agency  to 
evaluate  relevant  data  and  take  appropriate  actions.  Without  such  measures,  VA 
is  limited  in  its  ability  to  assess  its  programs. 
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GAO 

441  G  St.  N.W. 
Washington,  DC  20548 


U.S.  GOVERNMENT  ACCOUNTABILITY  OFFICE 


November  12,  2015 

The  Honorable  Brad  Wenstrup 
Chairman 

Subcommittee  on  Economic  Opportunity 
Committee  on  Veterans  Affairs 
House  of  Representatives 

The  Honorable  Mike  Coffman 
House  of  Representatives 

The  Honorable  Bill  Flores 
House  of  Representatives 

As  the  military  draws  down  its  forces  over  the  next  few  years,  tens  of 
thousands  of  servicemembers  are  expected  to  transition  into  civilian  life.1 
To  better  prepare  themselves  for  meaningful  employment,  many  will  seek 
educational  and  training  opportunities,  which  include  on-the-job  training 
(OJT)  and  apprenticeships.  In  2011,  provisions  were  enacted  that 
extended  benefits  under  the  Post-9/11  Veterans  Educational  Assistance 
Act  of  2008  (Post-9/1 1  Gl  Bill)2  for  eligible  veterans  interested  in  such 
opportunities.3  Before  those  provisions  were  enacted,  Post-9/1 1  Gl  Bill 
benefits  were  available  to  attend  a  college  or  university,  which  may  not  be 
the  best  path  for  every  veteran.  For  those  who  may  not  be  interested  in 
higher  education,  OJT  and  apprenticeships  can  offer  interested  veterans 


^he  number  of  veterans  facing  this  transition  will  likely  grow  in  the  coming  years  as  the 
number  of  post-9/1 1  veterans  is  expected  to  increase  to  more  than  5  million  by  2020.  For 
more  information,  see  GAO,  VA  Education  Benefits:  VA  Should  Strengthen  its  Efforts  to 
Help  Veterans  Make  Informed  Education  Choices,  GAO-14-324  (Washington,  D.C.:  May 
13,2014). 

2Pub.  L.  No.  110-252,  tit.  V,  122  Stat.  2323,  2357-78  (codified  as  amended  at  38  U.S.C. 
§§  3301-3325). 

3Post-9/11  Veterans  Educational  Assistance  Improvements  Act  of  2010,  Pub.  L.  No.  HI- 
377,  §  105(b),  124  Stat.  4106,  4113-17  (2011)  (codified  at  38  U.S.C.  §  3313(g)). 
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an  opportunity  for  employment  and  to  improve  their  economic 
opportunities.4 

Given  the  importance  of  veterans’  employment  to  their  long-term  financial 
well-being,  you  asked  us  to  examine  the  Post-9/11  Gl  Bill  OJT  and 
apprenticeship  programs  administered  by  the  U.S.  Department  of 
Veterans  Affairs  (VA).  This  report  provides  information  on  the  following 
questions: 

(1)  How  have  selected  veterans  and  employers  used  the  Post-9/11 
OJT  and  apprenticeship  programs,  and  how  widely  have  these 
programs  been  used? 

(2)  To  what  extent  have  VA  and  states  taken  steps  to  inform  veterans 
and  employers  about  these  programs? 

(3)  What  challenges,  if  any,  do  veterans  and  employers  report  facing 
in  using  the  Post-9/11  OJT  and  apprenticeship  programs? 

(4)  To  what  extent  has  VA  assessed  the  performance  and 
effectiveness  of  its  Post-9/1 1  OJT  and  apprenticeship  programs? 

Our  approach  for  reviewing  the  Post-9/1 1  OJT  and  apprenticeship 
programs  was  comprised  of  various  methodologies.  For  example,  we 
conducted  four  surveys  to  gather  various  perspectives  on  aspects  of  the 
programs  that  spanned  several  of  our  research  questions,  including 
program  use,  outreach,  and  challenges  veterans  and  employers  reported 
in  using  the  programs.  (See  table  1.) 


4  A  recent  VA  report  on  veterans’  economic  opportunities  found  that  approximately  half  of 
all  post-9/1 1  veterans  transitioning  into  the  civilian  workforce  will  face  a  period  of 
unemployment  upon  transition.  VA,  2015  Veteran  Economic  Opportunity  Report,  U.S. 
Department  of  Veterans  Affairs. 
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Table  1:  Populations  Surveyed  by  GAO  About  Veterans’  On-the-Job  Training  and 
Apprenticeship  Programs 

Survey  Description 

Responses 

Nongeneralizable  sample  of  veterans  who  have 
participated  in  Post-9/11  Gl  Bill  OJT  or 
apprenticeship  programs 

156  veterans  responded 

Nongeneralizable  sample  of  employers  and 
apprenticeship  sponsors  who  have  participated  in 
Post-9/11  Gl  Bill  OJT  or  apprenticeship  programs 

153  employers  or  apprenticeship 
sponsors  responded 

Nongeneralizable  sample  of  veterans  who  used 
their  Gl  Bill  benefits  for  non-college  degree 
programs  (not  OJT  or  apprenticeship  programs)3 

127  veterans  responded 

Survey  of  state  officials  in  all  44  states  that  oversee 
the  Gl  Bill  OJT  and  apprenticeship  programs 

All  44  states  responded3 

Source:  GAO  |  GAO-16-51 

aBenefits  are  also  available,  for  example,  for  training  at  vocational  or  technical  schools. 

blf  a  state  fails  to  designate  or  contract  with  VA  for  reimbursement  to  a  state  approving  agency,  VA 
functions,  in  effect,  as  the  approving  agency  for  that  state.  38  U.S.C.  §  3671(b). 


For  our  first  objective,  we  analyzed  VA  program  data  and  conducted  two 
nongeneralizable  surveys — one  of  veterans  who  have  participated  in  the 
Post-9/11  Gl  Bill  OJT  or  apprenticeship  programs  and  one  of  employers 
and  apprenticeship  sponsors  who  have  participated  in  these  programs. 
Specifically,  we  requested  and  analyzed  data  from  two  VA  datasets,  the 
Long  Term  Solution  database,  which  includes  information  on  the  number 
of  veterans  who  have  received  Post-9/11  Gl  Bill  benefits  under  the  OJT 
and  apprenticeship  programs,  and  the  Web  Enabled  Approval 
Management  System,  which  includes  information  on  the  number  of 
approved  OJT  and  apprenticeship  facilities.  For  both  sources,  the  data 
VA  provided  covered  participants,  employers,  and  apprenticeship 
sponsors  who  participated  in  the  program  between  October  1,  2011, 
when  OJT  and  apprenticeship  benefits  first  became  available,  and  March 
23,  2015,  the  most  current  data  available  at  the  time  of  our  review.  We 
assessed  the  reliability  of  these  data  by  reviewing  existing  information 
about  the  data  and  the  system  that  produced  them  and  by  interviewing 
agency  officials  knowledgeable  about  the  data.  We  determined  that  the 
data  were  sufficiently  reliable  for  the  purposes  of  this  report.  For  our 
survey  of  participating  veterans,  we  selected  participants  in  a  probability 
sample  stratified  by  gender.  We  sent  a  web-based  survey  to  5,200 
veterans  and  received  responses  from  156.  Similarly,  for  our  survey  of 
participating  employers  and  apprenticeship  sponsors,  we  randomly 
sampled  600  participating  employers  and  apprenticeship  sponsors  with 
email  addresses,  and  received  responses  from  153.  While  not 
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generalizable,  the  findings  from  these  surveys  allowed  us  to  provide  a 
greater  range  of  participant  perspectives  than  we  could  have  gathered 
through  site  visits  alone. 

For  our  second  objective,  we  conducted  a  third  survey  of  officials  in  all  44 
states  that  oversee  the  OJT  and  apprenticeship  programs.  We  also 
conducted  site  visits  in  Missouri  and  North  Carolina  and  interviewed  state 
officials  from  an  additional  11  states  (Arizona,  Illinois,  Iowa,  Louisiana, 
Maine,  New  York,  Oregon,  South  Carolina,  Tennessee,  Texas,  and 
Virginia.)  We  chose  these  13  states  to  reflect  a  range  in  the  number  of 
active  OJT  and  apprenticeship  programs,  the  number  of  Post-9/11 
veterans  within  the  population,  and  geographic  location.  While  not 
generalizable,  the  perspectives  of  officials  in  these  13  states  provided 
context  and  specific  examples  to  supplement  our  survey  findings.  We 
also  analyzed  VA  and  Department  of  Labor  (DOL)  website  information, 
and  VA  and  DOL  outreach  materials.  DOL  separately  administers  an 
apprenticeship  program  and  OJT  services  in  its  programs  serving  adult 
and  dislocated  workers.  Because  all  servicemembers  participating  in  the 
Transition  Assistance  Program  (TAP)5  must  take  VA  Benefits  I  and  II 
courses,  we  analyzed  curriculum  materials  from  these  courses.  We 
selected  these  portions  of  the  TAP  curriculum  because  they  are  intended 
to  be  comprehensive  and  cover  the  entire  spectrum  of  VA  benefits  for 
servicemembers  and  their  families.6  In  analyzing  what  steps  VA  has 
taken  to  inform  veterans  of  these  programs,  we  examined  to  what  extent 
VA  materials  include  information  on  the  Post-9/11  OJT  and 
apprenticeship  programs.  We  compared  these  informational  materials  to 
criteria  established  in  the  Plain  Writing  Act  of  201 07  and  Standards  for 


5TAP  was  originally  established  by  the  National  Defense  Authorization  Act  for  Fiscal  Year 
1991.  Pub.  L.  No.  101-510,  Sec.  502(a),  §  1142,  104  Stat.  1485,  1552-55  (1990).  It  has 
recently  been  redesigned  through  the  Veterans  Employment  Initiative  and  the  VOW  to 
Hire  Heroes  Act  of  2011.  Exec.  Order  No.  13,518,  74  Fed.  Reg.  58,533  (Nov.  13,  2009) 
and  Pub.  L.  No.  112-56,  §221,  125  Stat.711,  715-18.  The  redesigned  TAP  is  also  known 
as  Transition  Goals,  Plans,  Success  (Transition  GPS).  For  more  detailed  information 
about  TAP  see  Transitioning  Veterans:  Improved  Oversight  Needed  to  Enhance 
Implementation  of  Transition  Assistance  Program,  GAO-14-144  (March  5,  2014). 

6This  language  appears  in  a  VA  document  regarding  the  implementation  of  the  VOW  to 
Hire  Heroes  Act  of  201 1 . 

7Pub.  L.  No.  111-274,  §§  3(3)  and  4(b), 124  Stat.  2861, 2161-62  (codified  at  5  U.S.C.  § 
301  note). 
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Internal  Control  in  the  Federal  Government8  regarding  agencies’ 
communications  with  external  stakeholders. 

For  the  third  objective,  we  conducted  a  survey  to  learn  whether  a  lack  of 
awareness  among  veterans  could  be  a  barrier  to  participation. 

Specifically,  we  randomly  sampled  5,150  veterans  who  used  their  Gl  Bill 
benefits  to  attend  a  non-college  degree  program,  such  as  a  vocational 
school,  but  did  not  participate  in  the  OJT  or  apprenticeship  programs,  and 
received  responses  from  127  veterans.  Even  though  these  results  are  not 
generalizable,  the  survey  provides  information  on  the  extent  to  which 
survey  respondents  were  aware  of  the  OJT  and  apprenticeship  programs. 
We  also  analyzed  results  from  our  survey  of  state  officials  and  our  other 
two  non-generalizable  surveys  of  participating  veterans  and  of  employers 
and  apprenticeship  sponsors  to  identify  their  reported  challenges.  In 
addition,  we  interviewed  28  participating  veterans  and  15  participating 
employers  and  apprenticeship  sponsors  during  our  site  visits  to  obtain 
specific  examples.  Lastly,  we  compared  information  on  VA’s  process  for 
submitting  and  processing  paperwork  for  benefits  with  standards  for 
internal  control  in  the  federal  government. 

For  our  fourth  objective,  we  requested  that  VA  provide  outcome  data  for 
its  OJT  and  apprenticeship  programs.  In  assessing  VA’s  capability  to 
provide  such  data  on  program  performance,  we  used  as  criteria 
standards  for  internal  control  in  the  federal  government  and  leading 
practices  for  federally  funded  employment  and  training  programs,  as  set 
out  in  the  Vice  President’s  Job  Driven  Training  Report.9  To  provide 
broader  information  on  the  performance  of  OJT  and  apprenticeship 
training  models,  we  obtained  outcome  data  on  DOL’s  programs.  More 
specifically,  we  requested  and  analyzed  DOL  outcome  data  on  OJT 
services  in  its  programs  serving  adult  and  dislocated  workers  from  the 
Workforce  Investment  Act  Standardized  Record  Data  (WIASRD)  data  on 


8GAO,  Standards  for  Internal  Control  in  the  Federal  Government,  GAO/AIMD-OO-2 1.3.1 
(Washington,  D.C.:  Nov.  1,  1999). 

9ln  2014,  the  President  issued  a  presidential  memorandum  on  job-driven  training  for 
workers.  This  memorandum  tasked  a  Cabinet  team,  led  by  the  Vice  President,  to  issue  a 
report  within  180  days  outlining  a  plan  to  make  America’s  workforce  and  training  system 
more  job-driven,  integrated,  and  effective.  The  subsequent  report  was  issued  in  July  2014. 
The  White  House  Ready  to  Work:  Job-Driven  Training  and  American  Opportunity 
(Washington,  D.C.:  2014).  The  vice  president’s  report  included  a  checklist  of  items  that 
agencies  should  follow  in  reforming  the  administration  of  their  job  training  programs. 
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Post-9/11  veterans  in  the  fourth  quarter  of  2013.  We  also  examined  DOL 
outcome  data  from  2014  pertaining  to  participants  in  Registered 
Apprenticeship  programs  from  the  Registered  Apprenticeship  Partners 
Information  Management  Data  System  (RAPIDS). We  selected  these 
timeframes  because  they  were  the  most  current  data  available  at  the  time 
of  our  review.  We  assessed  the  reliability  of  these  data  by  reviewing 
existing  information  about  the  data  and  the  system  that  produced  them 
and  by  interviewing  agency  officials  knowledgeable  about  the  data.  We 
determined  that  the  data  were  sufficiently  reliable  for  the  purposes  of  this 
report.  In  addition,  we  interviewed  experts  on  employment  and  training 
programs  to  better  understand  the  academic  literature  on  the 
effectiveness  of  DOL’s  OJT  services  and  apprenticeship  programs.  While 
the  views  of  these  experts  are  not  generalizable,  they  helped  provide 
perspectives  on  the  literature  related  to  the  effectiveness  of  OJT  and 
apprenticeship  training  models.  Finally,  for  all  objectives  we  reviewed 
relevant  federal  laws  and  regulations.  See  appendix  I  for  additional 
information  on  our  objectives,  scope,  and  methodology. 

We  conducted  this  performance  audit  from  August  2014  to  November 
2015  in  accordance  with  generally  accepted  government  auditing 
standards.  Those  standards  require  that  we  plan  and  perform  the  audit  to 
obtain  sufficient,  appropriate  evidence  to  provide  a  reasonable  basis  for 
our  findings  and  conclusions  based  on  our  audit  objectives.  We  believe 
that  the  evidence  obtained  provides  a  reasonable  basis  for  our  findings 
and  conclusions  based  on  our  audit  objectives. 


Background 


Gl  BiU  Overview  The  Department  of  Veterans  Affairs  (VA)  has  been  providing  veterans  Gl 

Bill  benefits  since  1944. 10  Among  several  Gl  Bill  programs,  the  Post-9/11 
Gl  Bill  program  has  become  the  largest.  The  Post-9/11  Gl  Bill — which 
took  effect  in  August  2009 — provides  benefits  to  veterans  and 
servicemembers  serving  on  active  duty  after  September  10,  2001. 11 


i  n 

VA  was  previously  named  the  Veterans  Administration  and  was  elevated  to  cabinet 
status  in  1988.  Department  of  Veterans  Affairs  Act,  Pub.  L.  No.  100-257,  §  2,  102  Stat. 
2635,2635  (1988). 

^Benefits  are  also  available  to  veterans  honorably  discharged  or  discharged  with  a 
service-connected  disability  after  30  days  of  service.  38  U.S.C.  §331 1(b). 
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Depending  on  what  education  or  training  program  they  select,  participants 
may  be  eligible  for  benefit  payments  for  up  to  36  months  to  cover  tuition 
and  fees,  housing,  and  books  and  supplies.12  From  2009  to  201 1 ,  the 
program  provided  benefits  only  to  participants  attending  a  degree¬ 
granting  institution  of  higher  learning.  However,  in  201 1  the  Post  9/1 1 
Veterans  Educational  Assistance  Improvements  Act  of  2010  expanded 
approved  programs  of  education  to  include  on-the-job  training  and 
apprenticeship,  as  well  as  other  types  of  non-degree  programs,  such  as 
vocational  or  technical  school. 


VAOJTand 

Apprenticeship  Programs 

OJT  and  Apprenticeship  Post-  Eligible  veterans  can  use  their  benefits  through  the  VA’s  Post-9/1 1  Gl  Bill 

9/1 1  Gl  Bill  Benefits  to  participate  in  an  approved  OJT  or  apprenticeship  program.  Veterans 

can  receive  benefits  for  an  OJT  program  lasting  from  6  months  to  2  years, 
or  for  an  apprenticeship  as  long  as  36  months13  until  their  Post-9/1 1  Gl 
Bill  benefits  are  exhausted.  When  veterans  opt  to  apply  their  Post-9/1 1  Gl 
Bill  benefits  to  an  eligible  OJT  or  apprenticeship  program,  in  addition  to 
the  wages  they  earn  from  their  employer  as  a  trainee  or  apprentice,  they 
receive  a  tax  free  monthly  housing  payment  from  VA  to  help  cover  living 
expenses.  The  amount  of  the  benefit  is  based  on  the  basic  allowance  for 
housing  (BAH)  paid  to  servicemembers.14  Veterans  receive  scheduled 


1238  U.S.C.  §  3312(a). 

1338  U.S.C.  §  3677(c)(2)  and  (3). 

1438  U.S.C.  §  331 3(g)(3)(B)(ii).  Specifically,  the  law  states  that  eligible  veterans  are  to 
receive  the  equivalent  of  the  BAH  for  a  service  member  with  dependents  in  pay  grade  E-5. 
Military  pay  grades  determine  both  the  BAH,  which  varies  by  ZIP  code,  as  well  as  basic 
pay  while  in  the  military.  In  2015,  annual  first-year  Post-9/1 1  OJT  and  apprenticeship 
benefits,  including  an  $83  per  month  books  and  supplies  stipend,  ranged  from  a  low  of 
$9,778  in  Altus,  Okla.,  to  a  high  of  $42,472  in  San  Francisco,  Calif.  Specifically,  in  2015  a 
veteran  living  in  Altus  and  in  the  program  would  receive  up  to  $896  per  month  for  the  first 
six  months  for  housing,  books,  and  supplies,  and  $733  per  month  for  the  second  six 
months.  Similarly,  a  veteran  living  in  San  Francisco  would  receive  up  to  $3,923  per  month 
for  housing,  books  and  supplies  for  the  first  six  months,  and  $3,155  per  month  for  the 
second  six  months  of  the  program. 
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wage  increases  from  their  employer  during  the  training  period.15  Every  6 
months,  the  monthly  benefit  received  from  VA  decreases.16  Furthermore, 
because  OJT  programs  can  be  supplemented  with  classroom 
components,  and  apprenticeship  programs  must  include  related 
instruction,  participants  may  receive  up  to  $83  per  month  to  help  cover 
the  cost  of  books  and  supplies.17  (See  table  2.) 


Table  2:  On-the-Job  Training  (OJT)  and  Apprenticeship  Benefit  Amounts  and 
Duration  Available  from  Veterans  Affairs  under  Post-9/11  Gl  Bill  since  October  1, 
2011 


Training  period  Monthly  rate 


First  6  months 

• 

• 

100  percent  of  applicable  Basic  Allowance  for  Housing 
(BAH) 

May  receive  up  to  $83  per  month  for  books  and  supplies 

Second  6  months 

• 

• 

80  percent  of  applicable  BAH 

May  receive  up  to  $83  per  month  for  books  and  supplies 

Third  6  months 

• 

• 

60  percent  of  applicable  BAH 

May  receive  up  to  $83  per  month  for  books  and  supplies 

Fourth  6  months 

• 

• 

40  percent  of  applicable  BAH 

May  receive  up  to  $83  per  month  for  books  and  supplies 

Remainder  of  training3 

• 

• 

20  percent  of  applicable  BAH 

May  receive  up  to  $83  per  month  for  books  and  supplies 

Source:  GAO  analysis  of  VA  Post-9/1 1  Gl  Bill  webpage  and  fact  sheets.  |  GAO-16-51 

aEligible  OJT  programs  generally  must  conclude  after  2  years,  however  apprenticeship  programs  may 
be  longer  and  veterans  may  continue  to  receive  Gl  Bill  benefits  until  the  benefits  are  exhausted. 


Program  Requirements  Program  requirements  and  the  approval  process  are  set  out  by  VA  and 
and  Approval  Process  the  State  Approving  Agencies  (SAAs)  in  their  training  manual  for  state 

officials.18  To  be  approved,  employers  sponsoring  OJT  programs  must 
complete  an  application  indicating  that  they  meet  a  number  of  criteria, 


1538  U.S.C.  §  3677(b)(1)(A).  Under  the  program  requirements,  while  veterans’  OJT  wage 
rates  start  at  50  percent  of  the  journeyman  wage  for  their  occupation,  upon  completion  of 
the  program  the  veteran  must  receive  at  least  85  percent  of  the  journeyman  wage.  The 
completion  wage  requirement  does  not  apply  to  public  sector  employees.  38  U.S.C.  § 
3677(b)(2). 

1638  U.S.C.  §  331 3(g)(3)(B)(i). 

1738  U.S.C.  §  331 3(g)(3)(B)(iii). 

1  ft 

SAA  National  Training  Curriculum ,  Unit  III:  Apprenticeship  and  On-the-Job  Training  and 
Programs.  (Aug.  1, 2010.) 
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including  creating  and  adhering  to  a  training  plan,  designating  a  certifying 
official,  having  “reasonable  certainty”  that  a  position  will  be  available 
when  the  veteran  completes  training,  and  paying  wages  that  meet 
program  requirements.  To  be  approved  for  the  Gl  Bill,  apprenticeship 
programs  must  meet  the  same  regulatory  criteria  they  would  need  to  be 
registered  with  DOL  or  a  State  Apprenticeship  Agency.19 

Specifically,  Gl  Bill-approved  OJT  programs20  are  intended  to  be  for  a  job 
that  is  learned  in  a  practical  way  through  a  structured,  systematic 
program  of  supervised  on-the-job  training;  however,  there  is  generally  no 
requirement  for  classroom  training.21  The  training  period  must  be  full-time, 
compensated  employment  that  is  a  minimum  of  6  months  and  a 
maximum  of  2  years  in  length.  Full-time  training  is  generally  considered  to 
be  not  less  than  30  hours  per  week. 

Similarly,  the  training  manual  provides  that  a  Gl  Bill-approved 
apprenticeship  program  must  be  a  structured,  organized,  written  program 
combining  on-the-job  training  and  related  instruction  in  which  workers 
learn  the  practical  and  theoretical  aspects  of  a  skilled  occupation. 
Employers  must  provide  incremental  wage  increases  to  participants 
throughout  the  apprenticeship.  The  length  of  an  apprenticeship  is 
generally  not  less  than  2,000  hours  of  full-time  work  experience  that  is 
consistent  with  training  requirements  as  established  by  industry  practices 
and  a  recommended  minimum  of  144  hours  of  related  instruction  per 
year.  Full-time  training  is  generally  considered  to  be  not  less  than  30 
hours  per  week  or  120  hours  per  month.  According  to  DOL,  individuals 
participating  in  an  apprenticeship  program  are  expected  to  advance  from 
a  low  or  no  skill,  entry-level  position  to  full  occupational  proficiency  at  the 
end  of  training. 

Gl  Bill-approved  OJT  and  apprenticeship  programs  for  non-federal 
employers  or  apprenticeship  sponsors  must  generally  be  approved  by  an 


1929  C.F.R.  pt.  29. 

on 

OJT  and  apprenticeship  programs  are  approved  for  multiple  Gl  Bill  programs;  for 
example,  veterans  can  apply  to  receive  benefits  under  the  Post-9/1 1  Gl  Bill  or  under  other 
Gl  Bill  programs,  such  as  the  Montgomery  Gl  Bill.  38  U.S.C.  §§  3002(3)(C)  and 
3687(a)(1). 

21Some  organizations  may  include  related  instruction  if  necessary. 
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SAA,  while  VA  approves  OJT  and  apprenticeship  programs  sponsored  by 
federal  agencies.22 

SAAs  are  state  agencies  designated  by  the  state’s  governor  that 
evaluate,  approve,  and  monitor  education  and  training  programs  for  the 
Gl  Bill  (see  fig.  I).23  SAAs  generally  contract  with  VA  to  approve  both 
educational  institutions  and  OJT  and  apprenticeship  programs.24  In 
addition  to  approving  programs,  SAA  staff  is  responsible  for  providing 
technical  assistance,  oversight,  and  program  outreach. 


Figure  1:  Approval  Process  for  On-the-Job  Training  (OJT)  and  Apprenticeship  Programs  for  Post-9/11  Gl  Bill  Benefits 


Applications  must  include 

□  Training  plan 

□  Wage  schedule 

□  Length  of  training 

□  Designation  of  Certifying  Official  form 

□  Training  agreement 


Source:  GAO  analysis  of  Department  of  Veterans  Affairs  (VA)  and  SAA  National  Training  Curriculum;  and  interviews  with  VA  officials.  |  GAO-16-51 

aVA  approves  Post-9/1 1  OJT  and  apprenticeship  programs  in  seven  states,  the  District  of  Columbia, 
and  for  federal  agencies. 


2238  U.S.C.  §§  3672(b)(1)  and  3677(a)  and  (b). 

oo 

The  part  of  state  government  in  which  SAAs  are  housed  varies  by  state.  For  example, 
SAAs  are  housed  within  the  veterans  affairs,  higher  education,  labor,  and  commerce 
departments. 

24Not  all  SAAs  are  involved  in  the  approval  and  supervision  of  apprenticeship  and  OJT 
programs;  in  some  states  the  VA  has  this  responsibility  because  those  states  chose  not  to 
contract  with  VA  to  administer  aspects  of  the  program  themselves.  VA  is  currently  acting 
as  the  SAA  for  OJT  and  apprenticeship  approvals  in  six  states  and  the  District  of 
Columbia:  Alaska,  Connecticut,  Hawaii,  Maryland,  Rhode  Island  and  Vermont. 
Furthermore,  in  some  states,  the  state  agency  that  approves  OJT  and  apprenticeship 
programs  differs  from  that  which  approves  institutions  of  higher  education.  In  addition,  an 
apprenticeship  program  need  not  be  certified  by  DOL  or  a  federally  approved  State 
Apprenticeship  Agency  to  be  approved  as  a  Gl  Bill  program. 
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OJT  and  Apprenticeship 
Resources  through  DOL 


DOL  OJT  Services 


DOL  offers  OJT  services  that  are  separate  from  the  VA  Post-9/1 1  Gl  Bill 
OJT  program  and  follow  a  similar  model,  but  there  are  several  key 
structural  differences  between  these  programs  and  services.  DOL’s  OJT 
services  were  authorized  under  the  Workforce  Investment  Act  of  1998 
(WIA)25  and  now  operate  under  the  Workforce  Innovation  and  Opportunity 
Act  (WIOA)  enacted  in  2014. 26  Under  WIOA,  eligible  individuals,  including 
veterans,  can  receive  employment  training  assistance  and  referrals  from 
local  workforce  offices  known  as  American  Job  Centers  (formerly  called 
One-Stop  centers).  Consistent  with  WIOA,  American  Job  Centers  provide 
different  levels  of  services,  depending  on  an  individual’s  needs: 

•  Career  Services,  which  include  assistance  with  job  searches  and  job 
placement,  career  counseling,  and  developing  an  individual 
employment  plan;  and 

•  Training  Services,  including  OJT  programs  and  other  occupational 
training  opportunities.27 

American  Job  Center  staff  help  match  DOL  OJT  participants  to 
participating  employers  for  employment  and  training  opportunities.  Upon 
establishing  a  contract  for  the  provision  of  occupational  training, 
participating  employers  receive  a  subsidy  of  up  to  75  percent  of  the 
trainee’s  wages  to  compensate  for  training  costs.28  In  order  to  maintain 
their  eligibility,  employers  must  be  able  to  demonstrate  a  pattern  of 
providing  program  participants  with  long-term  employment  and  wages, 
benefits,  and  working  conditions  commensurate  with  unsubsidized 
employees  of  similar  work  experience.29 


25Pub.  L.  No.  105-220,  112  Stat.  936. 

26Pub.  L.  No.  113-128,  128  Stat.  1425  (2014). 

2729  U.S.C.  §  3174(c)(2)  and  (3). 

2829  U.S.C.  §§  3102(44)  and  3174(c)(3)(h)(i).  While  reimbursement  is  typically  set  at  up  to 
50  percent  of  the  participant’s  wage  rate,  states  and  local  areas  may  raise  this 
reimbursement  to  75  percent  of  wage  rates,  taking  into  account  certain  participant  and 
employer  factors  that  the  states  or  local  boards  may  deem  appropriate.  TEGL  3-15. 

2929  U.S.C.  §  3254(4). 
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There  are  several  key  differences  between  the  OJT  services  available  to 
veterans  through  DOL  and  the  OJT  programs  that  are  part  of  the  Post- 
9/11  Gl  Bill  (see  table  3).  Whereas  veterans  receive  a  regular  benefit 
equivalent  to  their  monthly  housing  allowance  as  part  of  the  Post-9/1 1  Gl 
Bill,  the  employers  receive  wage  subsidies  as  part  of  DOL  OJT  services. 
To  be  eligible  for  DOL  OJT  services,  a  veteran  must  have  been 
determined  by  American  Job  Center  staff  to  require  training  in  order  to 
gain  or  retain  employment.30  In  contrast,  Post-9/11  Gl  Bill  OJT 
participants  must  only  meet  the  length  of  military  service  requirements  in 
order  to  be  eligible  for  an  OJT  program.  Unlike  the  VA,  which  officials 
indicated  is  not  required  to  track  outcome  measures  for  OJT  participants, 
states  are  required  to  collect  and  report  data  to  DOL,  using 
Unemployment  Insurance  wage  records,  on  post-program  performance 
measures,  including  employment  retention  rates  and  earnings  gains.31 


3029  U.S.C.  §  3174(c)(3)(B)(i). 
3129  U.S.C.  §  3141. 
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Table  3:  Comparison  of  Department  of  Veterans  Affairs  (VA)  and  Department  of  Labor  (DOL)  On-the-Job  Training  (OJT) 
Programs  and  Services 


VA  Post-9/11  Gl  Bill  OJT  programs 

DOL  OJT  services 

Participant  eligibility 

Veterans  serving  on  active  duty  for  at  least  90 
days  since  Sept.  11, 2001;  veterans  honorably 
discharged  or  discharged  with  a  service- 
connected  disability  after  30  days  of  service  are 
also  eligible. 

Adult  and  dislocated  workers  who  have  been 
determined  by  American  Job  Center  staff  to  be  in 
need  of  additional  services  in  order  to  gain  or  retain 
employment 

Length  of  program 

6-24  Months 

Varies  depending  on  expectations  of  occupation,  and 
local  workforce  areas  may  set  limits  on  funds  per 
trainee. 

Payment  of  benefits 

Post-9/11  Gl  Bill  benefit  to  veteran  in  the  form  of 
a  monthly  housing  benefit  payment:3 

•  which  depends  on  the  employer  or 
apprenticeship  sponsors’  locality 

•  and  which  decreases  every  six  months  as 
wages  periodically  increase  (wages  must 
start  at  no  less  than  50  percent  of  wages  for 
the  job  for  which  the  participant  is  being 
trained  and  must  be  raised  in  regular 
increments) 

Subsidy  to  employer  typically  equaling  50  percent  but 
as  high  as  75  percent  of  wage  rate  that  must  meet 
the  following  conditions: 

•  participant  must  make  at  least  minimum  wage 

•  participant  must  be  compensated  equally  to 
trainees  or  employees  who  have  similar  training, 
experience,  and  skills 

Performance  data 
collection  requirements 

None  required 

States  required  to  report  on  (at  minimum) 

•  employment  retention  rate  during  the  second  and 
fourth  quarters  after  program  exit; 

•  post-program  median  earnings  during  the  second 
quarter  after  program  exit 

Source:  GAO  Analysis  of  VA  and  DOL  statutes,  regulations,  and  program  descriptions.  |  GAO-16-51 

aThe  monthly  housing  benefit  payment  generally  corresponds  to  a  military  Basic  Allowance  for 
Housing  for  an  E-5  with  dependents.  Military  pay  grades  determine  both  housing  benefits,  which  vary 
by  ZIP  code,  and  basic  pay  while  in  the  military.  38  U.S.C.  §  331 3(g)(3)(A)(ii)(l)(aa). 


DOL  Apprenticeship 
Programs 


Distinct  from  Post-9/1 1  Gl  Bill  apprenticeship  programs,  veterans  can 
also  participate  in  DOL’s  Registered  Apprenticeship  program.32  In  concert 
with  recognized  state  apprenticeship  agencies,  DOL’s  Office  of 
Apprenticeship  determines  which  programs  meet  the  standards  to  be 
registered  with  DOL.33  For  the  Post-9/11  Gl  Bill,34  an  apprenticeship 


3229  C.F.R.  pt.  29. 

oo 

DOL’s  Office  of  Apprenticeship  administers  Registered  Apprenticeship  programs  in  25 
states,  while  State  Apprenticeship  Agencies  administer  the  Registered  Apprenticeship 
program  in  the  remaining  states. 
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program  does  not  need  to  be  registered  with  DOL  to  be  approved,  but  if  a 
program  is  registered,  its  training  plan  is  deemed  approved  for  purposes 
of  the  VA  program.35 

Registered  Apprenticeship  occupations  are  offered  in  such  fields  as 
electrical  work,  carpentry,  plumbing,  and  roofing.36  In  addition  to 
monitoring  compliance  with  program  requirements,  the  Office  of 
Apprenticeship  partners  with  employers,  workforce  agencies,  colleges, 
the  military,  and  other  organizations  to  promote  Registered 
Apprenticeships  and  provide  technical  assistance.  As  with  OJT  programs, 
DOL  requires  Registered  Apprenticeship  agencies  to  monitor 
performance  using  completion  rates,  among  other  indicators,37  and 
enables  these  agencies  to  access  participants’  wage  records  through  the 
Wage  Record  Interchange  System  (WRIS)  to  report  on  performance 
measures  such  as  employment  retention  and  earnings  gains.38  VA  is  not 
required  by  law  to  track  outcomes  for  Post-9/1 1  Gl  Bill  apprenticeship 
participants,  according  to  VA  officials.  (See  table  4.) 


34ln  addition  to  the  Post-9/11  Gl  Bill,  OJT  and  apprenticeship  programs  are  approved  for 
other  Gl  Bills,  such  as  the  Montgomery  Gl  Bill. 

3538  U.S.C.  §§  3672(b)(2)(iii).  To  be  approved,  however,  a  non-registered  apprenticeship 
must  meet  the  standards  applicable  to  registered  apprenticeships.  38  C.F.R.  §  21.4261. 

36DOL  regulations  state  that,  to  be  considered  a  federally  apprenticeable  occupation,  the 
occupation  must  combine  on-the-job  training  with  related  instruction  and  must  require  at 
least  2,000  hours  of  learning  to  attain  industry-standard  skills.  An  occupation  must  also  be 
clearly  identified  and  commonly  recognized  throughout  an  industry.  29  C.F.R.  §  29.4 

3729  C.F.R.  §29.6. 

oo 

DOL  and  states  participate  in  WRIS,  an  interstate  data-sharing  arrangement  for 
purposes  of  assessing  performance  for  programs  under  the  Workforce  Investment  Act  and 
certain  other  programs.  WRIS  2,  developed  after  WRIS  1 ,  has  a  policy  of  sharing  wage 
records  with  federal  or  state  agencies  operating  other  programs  outside  of  DOL,  but  only  if 
those  agencies  are  required  by  law  to  meet  performance  measures.  Department  of  Labor, 
Employment  and  Training  Administration,  WRIS2  Data  Sharing  Agreement  (Washington, 
D.C.:  2011). 
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Table  4:  Comparison  of  Department  of  Veterans  Affairs  (VA)  and  Department  of  Labor  (DOL)  Apprenticeship  Programs 

VA  Post-9/11  Gl  Bill  apprenticeship  program 

DOL  Registered  Apprenticeship 

Participant  eligibility 

Veterans  serving  on  active  duty  for  at  least  90 
days  since  Sept.  11, 2001;  veterans  honorably 
discharged  or  discharged  with  a  service- 
connected  disability  after  30  days  of  service  are 
also  eligible. 

Employees  at  least  16  years  old  in  an 
apprenticeable  occupation. 

Length  of  program 

Program  lengths  vary  by  apprenticeship  sponsor, 
but  benefits  end  after  36  months 

Varies  depending  on  apprenticeship 
sponsor 

Payment  of  benefits 

Post-9/11  Gl  Bill  Benefit  to  veteran  in  the  form  of 
a  monthly  housing  benefit:3 

•  which  depends  on  employer  or 
apprenticeship  sponsor’s  locality 

•  and  which  decreases  every  six  months  as 
wages  periodically  increase 

None 

Performance  data  collection 
requirements 

None  required 

Required  by  law  to  assess  performance 
using,  but  not  limited  to,  program 
completion  rates  and  Equal  Employment 
Opportunity  Compliance  Reviews 

Source:  GAO  Analysis  of  VA  and  DOL  materials  and  program  descriptions.!  GAO-16-51 

aThe  monthly  housing  benefit  payment  generally  corresponds  to  a  military  Basic  Allowance  for 

Housing  for  an  E-5  with  dependents.  Military  pay  grades  determine  both  housing  benefits,  which  vary 
by  ZIP  code,  and  basic  pay  while  in  the  military.  38  U.S.C.  §  331 3(g)(3)(A)(ii)(l)(aa). 

In  addition  to  American  Job  Center  staff  who  serve  all  jobseekers, 
including  veterans,  DOL’s  Veterans’  Employment  and  Training  Service 
funds  two  staff  positions  that  focus  on  promoting  veterans’  employment. 
Specifically,  DOL  funds  Local  Veterans’  Employment  Representatives 
(LVER)39  to  promote  veteran  employment  opportunities  and  coordinate 
training  services  for  veterans  by  building  relationships  with  employers  and 
working  with  staff  at  American  Job  Centers.  Additionally,  Disabled 
Veterans’  Outreach  Program  (DVOP)  specialists  provide  case- 
management  to  veterans  with  significant  barriers  to  employment,  such  as 
homelessness  or  disabilities.40 


DOL-Funded  Staff  to 
Support  Veterans’ 
Employment 


3938  U.S.C.  §4104. 
4038  U.S.C.  §4103A. 
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Veterans  in  Our 
Review  Said  the 
Post-9/11  OJT  and 
Apprenticeship 
Programs  Helped 
Them  Transition  to 
Civilian  Life,  but 
Relatively  Few 
Veterans  Have 
Participated 


Veterans  in  Our  Review 
Said  the  Program’s 
Supplemental  Income 
Helped  Them  Cover  Living 
Expenses  while  They 
Trained 


The  majority  of  veteran  participants  who  replied  to  our  survey  (125  of 
156)  cited  more  than  one  benefit  to  the  program.  Many  specifically  noted 
that  receiving  supplemental  income  to  help  them  cover  living  expenses 
during  their  transition  to  civilian  life  was  a  primary  benefit  (1 12  of  156).  In 
2015,  this  supplemental  income  ranged  from  $896  to  $3,923  per  month 
for  the  first  6  months,  depending  on  the  location  of  the  employer  or 
apprenticeship  sponsor.41  Many  veterans  we  interviewed  (21  of  28)  said 
that  this  supplemental  income  helped  them  offset  the  loss  of  income  they 
experienced  after  leaving  the  military.  For  example,  slightly  more  than  half 
the  veterans  we  interviewed  (1 6  of  28)  said  that  the  supplemental  income 
helped  them  pay  critical  living  expenses,  such  as  a  mortgage  or  car 
payment,  or  support  their  families.  (See  text  box.)  A  few  veterans  (4  of 
28)  told  us  that  without  the  Post-9/1 1  Gl  Bill  benefits  they  would  have 
needed  a  second  job,  which  would  have  made  it  difficult  to  focus  on 
learning  their  new  occupation. 


41These  figures  include  an  $83  per  month  books  and  supplies  stipend  as  well  as  100 
percent  of  the  lowest  and  highest  monthly  BAH  for  a  servicemember  in  pay  grade  E-5  with 
dependents  in  201 5.  The  monthly  benefit  amounts  decrease  by  20  percent  of  the  BAH 
every  six  months.  38  U.S.C.  §  3313(g)(3)(B). 
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Quotes  from  Veterans  GAO  Surveyed  Who  Have  Participated  in  the  Post-9/11  On- 
the-Job  Training  (OJT)  or  Apprenticeship  Programs 

“[This  program]  has  helped  me  tremendously  in  my  transition  and  allowed  my  family  to 
survive  while  I  learned  a  new  trade  so  that  I  could  again  provide  for  them.”  -  32-year 
old  male  who  served  in  the  Army  National  Guard  before  participating  in  an  OJT 
program  to  become  an  electrician 

“The  hardest  thing  I  ever  had  to  do  in  my  life  was  make  the  transition  from  military  to 
civilian  life.  The  Post-9/11  Gl  Bill  allowed  me  to  go  to  the  police  academy  and  helped 
me  while  I  learned  a  new  craft.  It  eased  the  pressure  in  an  already  stressful  situation.  In 
addition,  it  gave  me  the  tools  to  succeed.  I  am  not  sure  if  I  would  have  been  as 
successful  without  the  help.”  -41 -year  old  male  Army  veteran  who  participated  in  an 
OJT  program  to  become  a  deputy  sheriff 

“This  is  a  great  program.  I  was  really  happy  to  find  out  it  was  available.  I  didn't  want  to 
lose  out  on  my  VA  education  benefits.  I  tried  college  but  trying  to  work,  raise  a  family, 
and  go  to  school  was  hard.”  -32-year  old  male  Navy  veteran  who  participated  in  a  3- 
year  apprenticeship  program  to  become  an  overhead  lineman 

“This  program  is  vital  to  military  veterans  transitioning  into  public-service  related 
occupations.  It  helped  me  to  gain  entry-level  experience  in  the  law  enforcement 
profession  after  leaving  a  successful  career  in  the  military.  I  personally  would  not  have 
been  able  to  pursue  this  profession  without  this  program  during  my  transition.”  -  male 
Marine  Corps  veteran  who  participated  in  a  police  officer  apprenticeship  program 

Source:  GAO  survey  of  veterans  who  have  participated  in  the  Post-9/1 1  OJT  or  apprenticeship  programs  |  GAO-16-51 


In  addition  to  providing  supplemental  income,  about  half  of  the  OJT  and 
apprenticeship  participants  who  responded  to  our  survey  (80  of  156) 
reported  that  the  programs  allowed  them  to  use  their  Gl  Bill  benefits,  to 
which  they  are  entitled,  when  college  was  not  a  good  fit  for  them.  Several 
veterans  we  interviewed  (4  of  28)  said  they  had  not  expected  to  be  able 
to  use  their  Gl  Bill  benefits  because  they  knew  they  wanted  to  enter  a 
specific  trade  or  occupation  that  did  not  require  a  college  degree,  such  as 
pipefitter  or  police  officer.  These  veterans  said  they  were  pleased  to  be 
able  to  use  the  benefits  they  had  earned  while  starting  their  chosen 
careers.  Others  (6  of  28)  said  that  due  to  family  obligations  they  needed 
to  work  full  time  and  would  not  have  been  able  to  afford  college.  Further, 
some  OJT  and  apprenticeship  participants  who  responded  to  our 
survey — including  both  those  who  had  and  had  not  used  Post-9/1 1  Gl  Bill 
benefits  to  attend  college — reported  one  of  the  main  benefits  of  the 
program  was  that  it  helped  them  learn  a  new  occupation  (86  of  156)  and 
further  develop  skills  they  had  obtained  in  the  military  (60  of  156). 

VA  officials  told  us  that  employers  and  apprenticeship  sponsors  do  not 
receive  any  federal  funds  for  participating  in  these  programs,  though  the 
employers  and  apprenticeship  sponsors  who  responded  to  our  survey 
cited  a  number  of  benefits  for  participating,  particularly  recruitment  and 
retention.  Specifically,  just  over  half  of  the  employers  and  apprenticeship 
sponsors  who  responded  to  our  survey  (87  of  153)  reported  the  program 
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helped  them  recruit  veterans  to  be  employees.  Almost  all  of  the 
employers  and  apprenticeship  sponsors  we  interviewed  (12  of  15)  praised 
the  discipline,  work  ethic,  or  customer  service  skills  of  participating 
veterans,  or  said  they  made  valuable  employees  or  apprentices.  In 
addition  to  recruitment  benefits,  half  of  the  employers  and  apprenticeship 
sponsor  respondents  (76  of  153)  indicated  that  the  programs  had  helped 
them  retain  veterans  as  employees.  Some  employers  and  apprenticeship 
sponsors  who  responded  (47  of  153)  also  indicated  that  the  program 
enhanced  their  standing  in  the  community.  (See  text  box.) 


Quotes  from  Employers  and  Apprenticeship  Sponsors  GAO  Surveyed  Who  Have 
Participated  in  the  Post-9/11  On-the-Job  Training  (OJT)  or  Apprenticeship 
Programs 

“Our  department  promotes  the  hiring  of  veterans,  and  we  believe  this  program 
enhances  that  philosophy.”  -certifying  official  for  a  police  officer  training  apprenticeship 
“[The  program]  helps  our  veterans  financially  when  they  are  not  at  the  top  pay  scale 
rate.”  -certifying  official  for  a  firefighting  apprenticeship  program 
“It’s  a  great  program — one  that  says  Thank  you’  to  our  veterans  and  their  families  for 
the  sacrifices  they  made.  Word-of-mouth  spreads  fast  among  our  highway  maintainers. 
I  only  wish  more  could  participate.”  -certifying  official  for  a  highway  maintainer  OJT 
program 

Source:  GAO  survey  of  employers  and  apprenticeship  sponsors  who  have  participated  in  the  Post-9/1 1  OJT  or  apprenticeship 
programs  |  GAO-16-51 


Since  2011,  About  27,000 
Veterans  Have 
Participated  in  the  Post- 
9/11  Gl  Bill  OJT  and 
Apprenticeship  Programs 
to  Train  in  a  Variety  of 
Occupations 


Of  the  approximately  1 .2  million  veterans  who  used  their  Post-9/1 1  Gl  Bill 
benefits  since  October  201  1,42  about  27,000 — or  about  2  percent — 
participated  in  the  OJT  or  apprenticeship  programs,  according  to  VA 
program  data.43  Approximately  half  of  these  veterans  participated  in  OJT 
opportunities,  while  the  other  half  pursued  apprenticeships.  The  average 
age  of  participants  was  33,  and  most  were  male  (94  percent).  Over  half  of 
all  participants  had  served  either  in  the  Army  (28  percent)  or  the  National 
Guard  or  Reserves  (27  percent).  (See  table  5.)  The  number  of 
participating  veterans  varied  considerably  by  state,  for  example,  from  a 
low  of  14  participants  in  Wyoming  to  a  high  of  799  in  Texas  during  fiscal 
year  2014. 


42Prior  to  201 1 ,  Post-9/1 1  Gl  Bill  benefits  were  only  available  for  higher  education. 

43Specifically,  these  data  come  from  VA’s  Long  Term  Solution  (LTS)  database  and  include 
participants  from  Oct.  1, 2011  through  March  23,  2015,  the  most  current  data  available  at 
the  time  of  our  review. 
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Table  5:  Characteristics  of  Veterans  Participating  in  the  Post-9/11  Gl  Bill  On-the-Job 
Training  (OJT)  and  Apprenticeship  Programs,  October  1,  2011-March  23,  2015 


Program  type 

Number  of  participants 

Percentage  of  participants 

Apprenticeship 

13,533 

49% 

OJT 

13,926 

51% 

Gender3 

Male 

25,850 

94% 

Female 

1,607 

6% 

Branch  of  service1” 

Army 

7,819 

28% 

Reserve  or  National 
Guard 

7,306 

27% 

Marine  Corps 

5,010 

18% 

Navy 

4,198 

15% 

Air  Force 

2,635 

10% 

Coast  Guard 

451 

2% 

Average  age 

33  years  old 

Source:  GAO  analysis  of  VA  Long-Term  Data  Solution  (LTS)  data  as  of  March  23,  2015.  |  GAO-16-51 

aFor  two  participants  gender  was  not  identified,  so  the  total  number  of  participants  does  not 
correspond  to  the  total  for  OJT  and  apprenticeship. 

bFor  40  participants,  the  branch  of  service  was  unknown,  so  the  total  number  of  participants  does  not 
correspond  to  the  total  for  OJT  and  apprenticeship. 


During  fiscal  year  2014,  there  were  approximately  2,700  employers  and 
apprenticeship  sponsors  approved  to  train  Post-9/1 1  Gl  Bill  veterans. 
According  to  VA  and  state  officials,  not  all  of  these  approved  OJT  and 
apprenticeship  sponsors  actually  had  veterans  receiving  benefits  under 
the  program  during  this  timeframe. 

Participating  veterans  have  used  the  OJT  and  apprenticeship  programs  to 
train  in  a  variety  of  occupations.  While  VA  officials  told  us  the  agency 
does  not  collect  standardized  occupational  data,  our  analysis  of  VA’s 
administrative  data  on  approved  programs  indicates  that  the  following 
occupations  are  among  those  most  frequently  pursued  by  participants: 

•  Police  and  sheriff  officer 

•  Correctional  officer  and  jailor 

•  Truck  driver 

•  Electrician 

•  Firefighter 

•  Air  traffic  controller 
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•  Immigration  and  customs  inspector 

•  Veterans  service  representative 

•  Carpenter 

•  Plumber,  pipefitter,  and  steamfitter 

In  addition,  veterans  we  interviewed  reported  being  trained  for  a  variety  of 
other  positions,  including  maintenance  and  repair  workers,  special 
agents,  and  cable  installation  and  maintenance  technicians. 


VA  and  States 
Provide  Varying 
Levels  of  Information 
and  Outreach  to 
Veterans  and 
Employers 


VA  Provides  Some 
Program  Information  That 
Generally  Highlights 
School-Based  Options  and 
Lacks  Sufficient  Detail  On 
OJT  and  Apprenticeships 


While  VA  provides  some  information  on  Post-9/11  Gl  Bill  OJT  and 
apprenticeship  programs,  the  focus  of  most  outreach  information  is  on 
higher  education  benefits.  OJT  and  apprenticeship  information  lacks 
sufficient  detail  to  inform  veterans  these  benefits  are  available  or  how 
they  might  be  used.  There  are  a  few  different  resources  available  to 
servicemembers — and  to  some  extent,  employers — that  provide 
information  on  Post-9/11  Gl  Bill  benefits,  including  information  shared  at 
mandatory  pre-separation  briefings  as  part  of  the  Transition  Assistance 
Program  (TAP),  on  agency  websites,  and  as  part  of  VA’s  education  and 
career  counseling.44 


Transition  Assistance  Program 
(TAP) 


In  general,  mandatory  briefings  provided  by  VA  for  separating 
servicemembers  as  part  of  TAP  cover  Post-9/1 1  Gl  Bill  benefits,  but 
almost  all  of  this  information  is  focused  on  using  these  benefits  for  higher 
education.  The  purpose  of  TAP  is  to  prepare  servicemembers  leaving  the 
military  for  their  transition  back  into  civilian  life.  TAP  includes  both 


4438  U.S.C.  §  3697A. 
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mandatory  and  optional  components.45  For  example,  all  servicemembers 
participating  in  TAP  must  take  VA’s  Veterans  Benefits  I  and  II  courses, 
which  discuss  available  benefits  and  services,  including  education 
benefits.46  Federal,  state,  and  veterans  service  organization  officials  we 
interviewed  identified  TAP  as  one  of  the  primary  ways  that  veterans  can 
learn  about  the  Post-9/1 1  OJT  and  apprenticeship  programs.  However, 
out  of  77  total  pages  in  the  TAP  facilitator  guide  and  briefing  slides  for  the 
VA  Benefits  I  and  II  courses,  there  is  one  reference  to  the  OJT  and 
apprenticeship  programs  as  part  of  a  description  of  the  books  and 
supplies  stipend  portion  of  the  Post-9/11  Gl  Bill.  In  discussing  Post-9/11 
Gl  Bill  benefits,  the  briefing  slides  generally  refer  to  “education,”  “tuition,” 
“school,”  and  “student,”  and  do  not  refer  to  employers,  OJT,  or 
apprenticeship  opportunities,  although  these  options  are  also  available. 
Presenting  this  information  in  Veterans  Benefits  I  and  II  courses  would 
align  with  VA’s  stated  goal  that  these  briefings  be  comprehensive  and 
cover  the  entire  spectrum  of  VA  benefits  for  servicemembers  and  their 
families.47 

Similarly,  the  Veterans  Benefits  I  and  II  briefing  slides  do  not  include  any 
specific  examples  of  veterans  who  have  used  their  benefits  for  OJT  or 
apprenticeship  opportunities  or  how  these  benefits  work.  Information  on 
the  OJT  and  apprenticeship  program  of  Post-9/11  Gl  Bill  benefits  is 
included  in  an  optional  portion  of  TAP,  called  the  Career  Technical 
Training  Track.  But  here  as  well  there  is  relatively  little  information 
provided  to  servicemembers  on  how  they  can  use  their  Post-9/1 1  benefits 
to  pursue  OJT  and  apprenticeship  opportunities.  Several  slides  in  this 
track  provide  information  on  what  OJT  and  apprenticeship  programs  are, 
however,  it  is  not  clear  that  veterans  can  use  their  Post-9/1 1  Gl  Bill 
benefits  for  these  programs. 

As  discussed  later  in  this  report,  39  of  44  SAAs  reported  that  lack  of 
awareness  of  the  Post-9/11  Gl  Bill  OJT  and  apprenticeship  programs  was 


450ur  analysis  of  TAP  curriculum  materials  focused  on  two  mandatory  portions  of  the  TAP 
program  overseen  by  VA:  VA  Benefits  I  and  II.  It  also  included  one  optional  training  track 
overseen  by  VA — the  Career  Technical  Training  Track. 

46These  briefings  also  include  information  on  other  benefits,  including  health,  home  loan 
guaranty,  insurance  and  disability  benefits. 

47This  language  about  VA’s  goal  for  these  briefings  appears  in  a  VA  informational 
document  regarding  the  implementation  of  the  VOW  to  Hire  Heroes  Act. 
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Agency  Websites 


one  of  two  top  challenges  in  facilitating  veteran  participation.  This  finding 
was  also  supported  by  the  results  of  our  other  survey  efforts.  Specifically, 
about  half  the  veterans  who  responded  to  our  survey  reported  that  TAP 
briefings  do  not  include  enough  information  on  OJT  and  apprenticeship 
programs  under  Post-9/11  Gl  Bill  benefits.  Of  the  156  veterans  who 
responded  to  our  survey  and  have  used  their  Post-9/1 1  Gl  Bill  benefits  for 
OJT  and  apprenticeship,  81  reported  that  they  did  not  think  TAP 
adequately  informs  veterans  about  these  options.  Similarly,  63  of  the  127 
responding  veterans  who  have  used  their  Post-9/1 1  Gl  Bill  benefits  for  a 
non-college  degree,  such  as  a  trade  school  program,  had  the  same 
response.  While  5  of  the  7  veterans  service  organization  leaders  we 
interviewed  indicated  that  TAP  should  not  be  the  only  source  of 
information  for  veterans,  some  of  whom  find  it  difficult  to  process  the 
volume  of  information  presented  during  TAP,  additional  information  about 
the  Post-9/1 1  Gl  Bill  OJT  and  apprenticeship  programs  could  be 
beneficial  in  informing  servicemembers  of  their  options. 

VA  officials  told  us  they  have  not  considered  expanding  the  curriculum  of 
the  mandatory  courses  to  include  more  information  about  the  OJT  and 
apprenticeship  programs.  They  stated  they  only  have  a  limited  amount  of 
time  to  cover  a  wide  range  of  benefits  during  the  TAP  briefings  and  have 
prioritized  content.  VA  officials  told  us  that  they  revisit  their  TAP 
curriculum  on  an  annual  basis.  During  this  annual  process,  officials 
update  benefits  information  and  accommodate  new  material.  They  also 
stated  that  they  encourage  veterans  to  attend  the  optional  Career 
Technical  Training  Track,  which  includes  information  on  these  programs. 
However,  without  additional  information  about  the  OJT  and 
apprenticeship  program  options  under  the  Post-9/11  Gl  Bill,  veterans  may 
continue  to  lack  awareness  of  these  benefits,  as  discussed  later  in  the 
report. 

Focus  on  Higher  Education  Benefits 

Another  source  of  information  about  Post-9/1 1  Gl  Bill  benefits  are  agency 
websites,  and  while  VA’s  and  DOL’s  websites  provide  some  information 
on  these  benefits,  VA’s  website  is  more  focused  on  higher  education 
benefits.  According  to  the  Plain  Writing  Act  of  2010,  information  supplied 
to  the  public  regarding  any  federal  benefit  (including  in  paper  and 
electronic  publications,  forms,  notices  or  instructions)  must  be  clear, 
concise,  well-organized,  and  appropriate  for  the  intended  audience.  The 
President’s  guidance  for  implementing  this  act  states  that  “agencies 
should  communicate  with  the  public  in  a  way  that  is  clear,  simple, 
meaningful,  and  jargon-free,”  and  notes  that  “a  lack  of  clarity  may  prevent 
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people  from  becoming  sufficiently  aware  of  programs  or  services”  for 
which  they  are  eligible.  VA’s  website  has  resources  for  individuals  to  learn 
about  Gl  Bill  benefits,  including  a  web  page  for  the  Gl  Bill,  a  web  page 
dedicated  to  the  Post-9/1 1  Gl  Bill,  and  a  Gl  Bill  Comparison  Tool.  While 
there  is  also  a  web  page  for  the  OJT  and  apprenticeship  programs,  the 
language  used  on  the  other  Gl  Bill-focused  web  pages,  and  resources 
generally,  refers  to  higher  education  and  does  not  reference  OJT  or 
apprenticeships.  For  example,  the  main  heading  of  the  Gl  Bill  web  page  is 
“Education  and  Training.”  However,  the  rest  of  the  page  uses  language 
and  visual  cues  that  reference  higher  education,  such  as  “choose  a 
school”  and  “verify  school  attendance.”  Moreover,  the  logo  for  the  Post- 
9/1  1  Gl  Bill — a  graduation  cap  with  dog  tag  tassels — further  emphasizes 
higher  education  to  the  exclusion  of  other  types  of  Gl  Bill  benefits. 

VA’s  Gl  Bill  Comparison  Tool  also  uses  language  that  emphasizes  higher 
education,  even  though  the  tool  can  be  used  to  access  information  on 
employers.48  The  main  heading,  for  example,  is  “Choosing  a  School,”  and 
the  options  below  are  “About  Your  School”  and  “Compare  This  School” 
even  when  an  employer  is  chosen — it  may  not  be  apparent  to  veterans 
that  they  can  use  this  tool  to  explore  OJT  and  apprenticeship  benefits. 

Lack  of  Sufficient  Detail  on  OJT  and  Apprenticeship  Programs 

In  addition,  the  information  provided  on  VA’s  Post-9/11  Gl  Bill  web  page 
and  on  its  OJT  and  apprenticeship  web  page  lacks  enough  detail  for 
users  to  reasonably  understand  how  to  use  their  Gl  Bill  benefits  for  the 
OJT  and  apprenticeship  programs.  For  example,  the  page  content  does 
not  articulate  how  OJT  programs  are  different  from  apprenticeship 
programs — a  difference  that  could  have  meaningful  career  implications 
for  veterans.  Participants  in  an  apprentice  program,  for  example,  earn  a 
license  or  national  industry  certification  and  generally  train  longer,  while 
OJT  participants  generally  receive  a  certificate  of  completion  and  train  for 
a  shorter  period  of  time.  In  addition,  the  web  page  lists  three  occupations 
that  might  be  available  through  OJT  or  apprenticeship,  union  plumber, 
hotel  manager,  and  firefighter,  but  does  not  provide  additional  details, 
such  as  descriptions  of  what  OJT  or  apprenticeship  programs  associated 


A  O 

A  servicemember  can  use  the  tool  to  instantly  generate  a  personalized  estimate  of  Gl 
Bill  benefits,  along  with  some  information  about  a  facility’s  value  and  affordability.  For 
example,  a  veteran  can  use  the  tool  to  see  how  much  their  monthly  benefits  would  be 
while  working  for  a  selected  employer. 
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with  these  occupations  might  involve,  or  testimonials  on  how  actual 
veterans  used  and  benefited  from  these  programs.  In  addition  to  the 
requirements  for  clear  and  meaningful  communication  described  in  the 
Plain  Writing  Act  of  2010,  Standards  for  Internal  Control  in  the  Federal 
Government  state  that  management  should  ensure  there  are  adequate 
means  of  communicating  with  external  stakeholders  in  which  there  could 
be  a  significant  impact  on  the  agency  achieving  its  goals.49  Further,  VA’s 
strategic  goals  include  empowering  veterans  to  improve  their  well-being 
and  managing  and  improving  VA  operations  to  deliver  seamless  and 
integrated  support.50  Without  providing  sufficient  detail  regarding  the  OJT 
and  apprenticeship  programs,  VA  may  not  provide  veterans  complete 
information  to  understand  these  benefits,  and  may  not  fully  meet  its  goals 
of  serving  this  population. 

While  VA’s  OJT  and  apprenticeship  web  page  links  to  a  fact  sheet  on 
these  Post-9/11  Gl  Bill  programs,  this  fact  sheet  also  lacks  sufficient 
detail  to  help  veterans  and  employers  reasonably  understand  how  they 
can  participate.  For  example,  the  fact  sheet  describes  the  amount  of 
Post-9/11  Gl  Bill  benefit  payments,  but  does  not  describe  the  difference 
between  OJT  and  apprenticeship  programs,  or  provide  examples  of  how 
veterans  used  benefits  from  these  programs. 

In  contrast,  DOL  has  a  comprehensive  web  page  for  its  Registered 
Apprenticeship  program  that  specifically  targets  veterans.  It  also  includes 
information  about  potential  benefits  of  participating  in  an  apprenticeship, 
and  profiles  several  veterans  who  participated  in  the  program  while 
receiving  Gl  Bill  benefits.  These  profiles  provide  concrete  examples  of 
how  veterans  have  used  the  Gl  Bill  benefits  during  apprenticeships  in  a 
variety  of  fields  and  how  their  apprenticeships  helped  them  after  leaving 
the  military.  VA  does  not  link  to  this  page  from  its  OJT  and  apprenticeship 
web  page,  missing  an  opportunity  to  leverage  this  resource  and 
potentially  making  it  more  difficult  for  veterans  to  learn  about  these 
benefits  through  its  website. 

VA’s  Gl  Bill  web  pages  also  provide  little  information  for  employers  who 
may  be  interested  in  participating.  The  OJT  and  apprenticeship  web  page 


49GAO/AIMD-00-21 .3.1 

50Department  of  Veterans  Affairs,  Department  of  Veterans  Affairs  FY  2014-2020  Strategic 
Plan. 
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includes  two  sentences  directed  to  employers  stating  that  they  can 
participate  in  the  program  and  directing  them  to  their  SAA  office.  It  does 
not,  however,  provide  information  about  requirements  for  employers  or 
why  employers  might  want  to  participate,  which  could  help  attract 
employers  or  apprenticeship  sponsors  to  help  VA  achieve  its  goal  of 
improving  veterans’  well-being. 


VA’s  Education  and  Vocational 
Counseling 


Finally,  VA’s  education  and  vocational  counseling  includes  some 
information  on  Gl  Bill  benefits,  but  according  to  VA,  counselors  rely  on  the 
Gl  Bill  website  for  information  regarding  the  OJT  and  apprenticeship 
programs.  In  addition  to  TAP  and  agency  websites,  servicemembers  may 
participate  in  VA’s  education  and  vocational  counseling  to  learn  more 
about  their  benefits.51  VA  officials  told  us  that  benefits  advisors  are 
permanently  staffed  at  almost  300  military  installations  and  other  sites 
worldwide  and  provide  transition  and  outreach  briefings,  as  well  as 
individual  assistance,  guidance,  and  counseling  on  all  VA  benefits  and 
services.  According  to  VA  officials,  the  counselors  who  deliver  these 
benefits  are  trained  and  have  knowledge  of  OJT  or  apprenticeship 
programs.  When  asked  to  provide  training  materials  related  to  the  OJT 
and  apprenticeship  programs,  VA  officials  told  us  that  counselors  find 
information  about  OJT  and  apprenticeships  on  the  Gl  Bill  website. 


State  Officials  We 
Surveyed  Reported 
Providing  Outreach  to 
Veterans  and  Employers, 
Which  Varied  By  State 


Most  state  officials  we  surveyed  reported  that  they  reach  out  to  veterans 
using  direct  methods,  such  as  attending  job  fairs  and  providing  briefings 
and  presentations  to  veterans’  groups  (see  table  6). 52  Fewer  state  officials 
reported  using  broader  outreach  methods,  such  as  radio  or  television 
advertisements  or  social  media,  to  raise  awareness  of  the  programs. 
Some  state  officials  said  that  they  devote  considerable  staff  time  and 
resources  to  outreach  efforts.  For  example,  an  SAA  director  in  one  state 
told  us  his  agency  created  various  informational  materials  to  raise 


51The  VA  Vocational  Rehabilitation  and  Employment  Education  and  Career  Counseling 
program  provides  educational  and  vocational  counseling  services  to  transitioning 
servicemembers  within  6  months  of  discharge  from  active  duty,  veterans  within  1  year 
following  discharge  from  active  duty,  and  all  VA  education  beneficiaries.  These  services 
are  designed  to  provide  counseling  and  support,  help  the  individual  choose  a  career  goal, 
and/or  determine  the  course  needed  to  achieve  the  chosen  goal. 

52GAO  surveyed  the  44  states  where  the  SAA  performs  approval  functions  for  the  OJT 
and  apprenticeship  programs,  excluding  6  states  and  the  District  of  Columbia  where  VA 
serves  this  function.  According  to  VA  officials,  VA’s  Education  Liaison  Representatives 
perform  approval  work  if  the  SAA  chooses  not  to  do  so. 
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awareness  of  these  programs,  including  a  video  titled  “OJT:  It’s  not  Just 
for  College”  to  distribute  to  stakeholders,  a  monthly  newsletter  on 
veterans’  employment  issues,  and  program  fact  sheets  and  brochures  to 
be  displayed  in  American  Job  Centers  and  higher  education  veterans’ 
offices.  An  SAA  official  in  another  state  told  us  his  agency  arranged  for 
OJT  and  apprenticeship  program  information  to  be  printed  on  the  back  of 
state  unemployment  insurance  (Ul)  benefit  checks  and  works  with  DOL 
workforce  staff  to  leverage  employer  contacts.  However,  our  survey 
results  also  indicate  that  the  level  of  outreach  conducted  varies  by  state. 
Specifically,  officials  in  5  states  we  surveyed  indicated  that  due  to 
resource  constraints,  they  were  unable  to  engage  in  more  intensive 
outreach  efforts  for  veterans  or  employers. 


Table  6:  Most  Frequent  Methods  of  Outreach  to  Veterans  Reported  by  State 
Approving  Agencies  (SAA)  for  Post-9/11  Gl  Bill  On-the-Job  Training  (OJT)  and 
Apprenticeship  Programs,  July  2015 

Number  of  SAAs  who  said 

Outreach  methods  they  engaged  in  this  activity 

Job  fairs 

38 

Briefings  and  presentations  to  veterans  groups 

37 

Outreach  to  American  Job  Centers 

36 

Campus  visits 

32 

Mass  mailings  or  flyers 

22 

Travel  to  military  bases 

22 

Presentations  during  the  Transition  Assistance  Program 

18 

Social  media 

11 

Military  retirement  seminars 

11 

Radio  or  television  advertisements 

2 

Source:  GAO  analysis  of  SAA  survey  data  from  the  44  states  that  oversee  Post-9/1 1  OJT  and  apprenticeship  programs.  |  GAO-16-51 

Without  adequate  program  outreach,  veterans  who  could  benefit  may 
remain  unaware  of  these  programs  and  miss  opportunities  to  improve 
their  long-term  employment  prospects,  consistent  with  agency  goals. 
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VAand  DOL  Have 
Coordinated  to  Build 
Awareness  of  the  Post- 
9/1 1  Gl  Bill  Apprenticeship 
Programs 


VA  has  coordinated  some  aspects  of  its  Post-9/1 1  Gl  Bill  apprenticeship 
program  with  DOL’s  Registered  Apprenticeship  program  to  help  make 
apprenticeship  sponsors  and  veterans  aware  of  the  Gl  Bill  program.  By 
statute,  the  same  regulatory  requirements  apply  to  apprenticeship 
sponsors  seeking  Gl  Bill  approval  for  their  program  as  those  seeking 
approval  through  DOL’s  Registered  Apprenticeship  program.53  Prior  to 
2014,  this  process  was  not  streamlined,  and  SAAs  independently 
assessed  whether  a  Registered  Apprenticeship  program  sponsor  seeking 
approval  for  Gl  Bill  eligibility  met  these  regulatory  requirements.  In 
September  2014,  the  Secretaries  of  Veterans  Affairs  and  Labor 
announced  that  any  DOL  or  State  Apprenticeship  Agency-approved 
Registered  Apprenticeship  program  was  qualified  to  be  approved  under 
the  Post-9/1 1  Gl  Bill.  The  joint  letter  making  this  announcement  was  sent 
to  approximately  10,000  Registered  Apprenticeship  programs  to  alert 
program  officials  that  participating  veterans  could  be  eligible  to  receive 
benefits  under  the  Post-9/1 1  Gl  Bill,  according  to  VA  officials.  The  letter 
included  detailed  information  on  how  Registered  Apprenticeship 
programs  could  obtain  Gl  Bill  approval  and  also  contained  two  outreach 
flyers.54  One  flyer  was  designed  for  veterans.  The  other,  for  Registered 
Apprenticeship  sponsors,  provided  detailed  information  on  the  Gl  Bill 
program  and  its  benefits. 


DOL  also  conducted  two  additional  outreach  efforts,  one  targeted  at 
apprenticeship  sponsors  and  the  other  at  veterans,  to  raise  awareness 
that  veterans  can  receive  Gl  Bill  benefits  while  participating  in  a  DOL 
Registered  Apprenticeship  program.  Regarding  the  first  effort,  DOL 
officials  told  us  they  created  a  pop-up  window  that  appears  when 
apprenticeship  sponsors  enter  information  into  the  Registered 
Apprenticeship  database  about  a  new  apprentice.  The  pop-up  window 
reminds  sponsors  that  their  apprenticeship  program  is  qualified  to  be 
approved  under  the  Gl  Bill,  and  that  veteran  apprentices  may  be  entitled 
to  receive  Gl  Bill  benefits  while  participating  in  the  program.55  The  pop-up 


5338  U.S.C.  §  3687(a)(1). 

54This  letter  included  contact  information  for  SAAs  and  two  required  application  forms. 
These  forms  include  VA  Form  22-8865  “Employer’s  Application  to  Provide  Job  Training” 
(under  Title  38  U.S.  Code  Section  3677  or  3687)  and  VA  Form  22-8794  “Designation  of 
Certifying  Officials.” 

55This  pop-up  window  is  available  to  sponsors  in  the  33  states  that  use  DOL’s  Registered 
Apprenticeship  Partners  Information  Management  Data  System  (RAPIDS). 
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window  also  links  to  several  different  resources  created  by  both  DOL  and 
VA  that  apprenticeship  sponsors  can  use  to  learn  more  about  VA’s 
program.  Regarding  the  second  outreach  effort  to  veterans,  DOL  created 
a  Registered  Apprenticeship  website  targeted  specifically  to  veterans  that 
highlights  the  availability  of  Gl  Bill  benefits  for  apprenticeships.  VA 
requires  SAA  officials  to  meet  biannually  with  DOL’s  Local  Veterans 
Employment  Representatives  (LVER).  According  to  VA’s  contract  with 
SAA  staff,  the  purpose  of  these  meetings  is  to  ensure  that  students  who 
graduate  in  the  SAA’s  state  are  made  aware  of  employment  resources 
and  opportunities.  SAA  directors  we  interviewed  in  10  of  13  states  told  us 
these  meetings  were  generally  helpful,  noting  that  they  increased 
program  awareness  or  helped  SAA  staff  connect  with  employers.  One 
official  said  LVERs  are  “wonderful  ambassadors”  for  the  Post-9/1 1  Gl  Bill 
program.  In  contrast,  SAA  directors  we  interviewed  in  3  of  the  13  states 
indicated  that  while  their  staff  meet  with  LVER  staff  as  required,  these 
interactions  rarely  result  in  increased  program  awareness  about  the  Gl 
Bill  OJT  or  apprenticeship  programs. 

VA  and  DOL  have  more  coordination  for  apprenticeship  programs  than 
for  OJT,  possibly  due  to  structural  differences  in  how  OJT  services  are 
provided.  For  example,  the  administration  of  OJT  services  funded  by 
DOL,  which  occurs  at  the  local  level,  is  more  decentralized  than  for 
Registered  Apprenticeship  programs,  which  are  overseen  at  either  the 
federal  or  state  level.56 


56There  is  less  alignment  in  approval  requirements  for  VA  Gl  Bill  OJT  programs  and  those 
for  the  DOL  OJT  services.  Specifically,  approximately  550  local  workforce  investment 
boards  determine  the  extent  to  which  OJT  services  will  be  provided  at  more  than  2,500 
American  Job  Centers  nationwide. 
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Lack  of  Program 
Awareness  and 
Administrative 
Burdens  Have 
Challenged  Veterans 
and  Employers, 
According  to  State 
Officials  and  Program 
Participants 


Veterans  and  Employers 
Often  Lack  Awareness  of 
OJT  and  Apprenticeships 
as  Options  under  the  Post- 
9/11  Gl  Bill,  According  to 
State  Officials  and 
Program  Participants 


Veterans  and  employers  generally  lack  awareness  of  OJT  and 
apprenticeship  options,  and  they  most  often  heard  of  these  programs 
from  word-of-mouth  sources,  according  to  state  officials  and  program 
participants  we  surveyed.  Specifically,  most  state  officials  we  surveyed 
cited  lack  of  awareness  as  a  top  challenge  in  facilitating  veteran  (39  of 
44)  and  employer  (39  of  43)  use  of  the  Post-9/1 1  Gl  Bill  OJT  and 
apprenticeship  programs  (see  table  7).  In  addition,  most  state  officials  (39 
of  44)  cited  a  lack  of  understanding  among  veterans  as  to  how  they  can 
use  these  benefits  to  pursue  career  goals  as  a  top  challenge.  Similarly, 
the  most  common  challenge  experienced  by  responding  state  officials 
trying  to  facilitate  employer  participation  in  OJT  and  apprenticeship 
programs  is  a  lack  of  knowledge  of  this  option  among  employers  (39  of 
43). 
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Table  7:  Most  Frequently  Cited  Challenges  in  Facilitating  Veteran  and  Employer 
Participation  According  to  State  Approving  Agency  (SAA)  Officials  We  Surveyed  for 
Post-9/11  Gl  Bill  On-the-Job  Training  (OJT)  and  Apprenticeship  Programs 

Challenges 

Number  of 
SAAs  who  cited 
this  challenge 

Top  challenges  in  facilitating  veteran  participation3 

Lack  of  knowledge  about  this  option  among  veterans 

39 

Lack  of  understanding  among  veterans  as  to  how  they  could  use  this 
benefit  to  pursue  career  goals 

39 

Emphasis  in  Post-9/11  Gl  Bill  materials  on  education  rather  than  OJT 
or  apprenticeship 

36 

Emphasis  on  postsecondary  education  to  achieve  career  success 

33 

Difficulty  for  veterans  in  distinguishing  between  various  benefit 
options  and  programs  available  to  them 

30 

Administrative  burden/manual  payroll  processing  system  for  VA 
benefits 

24 

Top  challenges  in  facilitating  employer  participation13 

Lack  of  knowledge  about  this  option  among  employers 

39 

Lack  of  knowledge  of  SAA  and  its  functions  and  responsibilities 

28 

Employer  perception  of  program  as  difficult  and  confusing 

27 

Limited  knowledge  among  American  Job  Center  staff 

26 

Lack  of  incentive  for  employer  participation 

25 

Administrative  burden/manual  payroll  processing  system  for  VA 
benefits  discourages  employers  from  participating 

25 

Difficulty  distinguishing  OJT  and  apprenticeship  Gl  Bill  programs  and 
other  government  efforts  to  promote  veterans  employment 

25 

Required  wage  increases  discourage  private  sector  employers  from 
participating 

24 

Source:  GAO  survey  of  SAA  officials  from  44  states  that  oversee  Gl  Bill  OJT  and  apprenticeship  programs  |  GAO-16-51 

aAII  44  states  responded  to  the  survey,  however  in  several  instances  a  state  did  not  respond  to  a 
specific  question  or  subquestion.  For  all  but  the  last  subquestion  regarding  administrative  burden,  all 
44  states  responded.  For  the  last  subquestion,  42  states  responded. 

bFor  this  question,  43  states  responded. 


State  officials  we  surveyed  also  cited  some  of  the  same  challenges  that 
we  identified  in  our  review  of  VA’s  information  resources,  and  some 
confusion  about  the  OJT  and  apprenticeship  programs  that  may 
contribute  to  a  lack  of  knowledge  about  these  programs  (see  table  7). 
Specifically,  36  of  44  responding  state  officials  pointed  to  the  emphasis 
on  Post-9/1 1  Gl  Bill  materials  on  education  rather  than  OJT  or 
apprenticeship  as  a  challenge  in  facilitating  veteran  participation. 
Additionally,  30  of  44  responding  state  officials  indicated  that  veterans 
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have  difficulty  distinguishing  between  benefit  options  and  programs 
available  to  them.  Twenty-eight  of  43  responding  state  officials  said  that 
employers  lacked  knowledge  of  the  SAA  and  its  functions  and 
responsibilities.  In  addition,  25  of  43  responding  state  officials  indicated 
that  employers  have  difficulty  distinguishing  OJT  and  apprenticeship  Gl 
Bill  programs  from  other  government  efforts  to  promote  veterans’ 
employment. 

Some  veterans  (64  of  156)  who  used  OJT  and  apprenticeship  options 
under  the  Post-9/1 1  Gl  Bill  and  responded  to  our  survey  said  it  was 
difficult  to  find  information  about  the  program.  When  asked  how  they 
learned  about  the  OJT  and  apprenticeship  programs,  the  veterans  we 
surveyed  most  frequently  reported  they  heard  about  the  programs  from 
another  veteran  who  had  already  participated  (61  of  156)  or  from  their 
employer  (41  of  156).  For  example,  one  veteran  reported: 

“This  is  a  hidden  program  that  should  be  more  prominent  in  availability.  I  would  not  have 
known  I  could  use  the  OJT  program  if  not  for  word-of-mouth  from  another  employee.” 

Similarly,  participating  employers  and  apprenticeship  sponsors  who 
responded  to  our  survey  most  frequently  said  they  heard  about  the 
program  from  a  veteran  employee  (63  of  153)  or  an  SAA  official  (42  of 
153). 

Of  veterans  we  surveyed  who  used  Gl  Bill  benefits  for  a  non-college 
degree,  such  as  at  a  vocational  school,  about  half  of  those  who 
responded  (65  of  127)  said  they  did  not  know  about  the  OJT  and 
apprenticeship  program  options  when  deciding  how  to  use  their  benefits. 
About  half  of  the  responding  veterans  (37  of  65)  who  had  not  heard  about 
the  programs  reported  they  would  have  considered  using  their  benefits  to 
pursue  OJT  or  apprenticeships  rather  than  an  education  program  had 
they  known  this  was  an  option.  Further,  about  half  (63  of  127)  of  the 
responding  veterans  who  used  Gl  Bill  benefits  for  a  non-college  degree, 
such  as  at  a  vocational  school,  stated  that  TAP  did  not  adequately  inform 
them  that  they  can  use  their  Gl  Bill  benefits  for  these  programs. 

To  build  awareness  of  these  programs,  VA  officials  said  they  send 
multiple  letters  to  servicemembers  prior  to  their  separation  to  let  them 


Page  31 


GAO-16-51  VA  Benefits 


know  they  may  be  entitled  to  education  benefits.57  Two  of  these  letters 
include  a  statement  that  says  Post-9/1 1  Gl  Bill  benefits  are  available  for 
trade  schools,  apprenticeships,  and  OJT  in  addition  to  colleges  and 
universities.  In  addition,  in  2011  and  201 3  VA  completed  two  targeted 
outreach  campaigns.  VA  officials  told  us  these  outreach  campaigns  were 
online  and  targeted  the  five  states  that  had  the  highest  rates  of  veteran 
unemployment  in  2011,  and  the  five  states  with  the  next-highest  rates  of 
veteran  unemployment  in  2013.  According  to  VA,  the  first  campaign 
resulted  in  nearly  354,000  unique  individuals  visiting  the  web  page  that 
explained  the  expansion  of  the  Gl  Bill  to  OJT  and  apprenticeship,  among 
other  new  options.  The  second  campaign  resulted  in  an  additional  76,000 
visits  to  this  web  page.  VA  officials  told  us  they  have  since  consolidated 
their  web  pages  and  in  doing  so  eliminated  this  Gl  Bill  expansion  web 
page.  They  said  no  additional  VA  outreach  campaigns  have  been 
completed  or  are  planned,  absent  additional  funding,  among  other 
reasons.  While  word-of-mouth  discussion  of  the  Post-9/11  Gl  Bill  OJT  and 
apprenticeship  program  benefits  can  increase  program  awareness,  this  is 
not  a  systematic  method  of  outreach,  and  VA  officials  acknowledged 
there  is  room  for  improvement  in  their  outreach  approach. 


State  Officials  and 
Employers  We  Surveyed 
Reported  VA’s  Paper- 
Based  Payment  System, 
which  VA  Plans  to  Replace 
by  2017,  Is  Burdensome, 
and  Payments  Are 
Sometimes  Delayed 


VA  currently  processes  Gl  Bill  benefit  payments  for  OJT  and 
apprenticeship  program  participants  using  a  paper-based  system  that, 
according  to  those  employers  and  veterans  we  contacted,  is  inefficient 
and  burdensome,  and  sometimes  results  in  delayed  benefit  payments  to 
veterans.  For  veterans  to  receive  their  monthly  benefits,  the  current 
paper-based  system  requires  employers  or  apprenticeship  sponsors  to 
certify  the  number  of  hours  the  veteran  employee  has  worked  each  month 
and  to  submit  the  forms  by  mail  or  fax  to  the  regional  processing  center 
(see  fig.  2).  In  our  non-generalizable  survey  of  employers  and 
apprenticeship  sponsors,  94  of  the  153  respondents  cited  the  lack  of  an 
automated  system  for  submitting  monthly  paperwork  as  a  challenge  to 
participating  in  the  program.  For  example,  one  employer  we  surveyed 
reported: 


“There  is  no  way  to  verify  and  track  paperwork  that  has  been  submitted  via  fax  or  mail  and 
it  is  ‘lost’  [in]  1  out  of  3  submissions.” 


57These  letters  are  sent  after  a  servicemember  completes  12  and  24  months  of  service, 
and  6  months  prior  to  separation. 
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Further,  11  of  the  15  employers  and  apprenticeship  sponsors  we 
interviewed  said  this  process  is  burdensome  or  inefficient.  One  employer 
we  surveyed  reported: 


“The  biggest  time  drain  is  ‘faxing’  in  the  monthly  hour  logs.  This  is  an  antiquated  way  of 
doing  this  and  the  option  for  scanning  and  emailing  should  be  incorporated.” 


Benefit  Payment  Process 

T 


On-the-Job  (OJT)  and  Apprenticeship  Programs 


Figure  2:  Monthly 
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On-the-Job 
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or  apprenticeship 
program3 
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“Certification 
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form,  which  the 
employer  certifies6 


for  Post-9/11  Gl  Bill 
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veteran  employee 
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to  Department  of 
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processing  center 
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processing  center 
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H  Veteran 
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paid  Post-9/11 
Gl  Bill  benefit 
payment 


Source:  GAO  analysis  of  Department  of  Veterans  Affairs  (VA)  documents  |  GAO-16-51 

aGenerally  this  process  occurs  after  each  month  of  work,  however,  it  can  occur  retroactively  for  a  number  of  months. 
bln  the  case  of  the  apprenticeship  program,  apprenticeship  sponsors  generally  certify  hours  worked. 


Seven  of  the  15  employers  and  apprenticeship  sponsors  we  interviewed 
also  said  they  often  had  to  re-submit  monthly  certifications  multiple  times 
because  VA  officials  said  they  had  not  received  them.  Several  employers 
and  apprenticeship  sponsors  told  us  they  save  all  fax  transmissions  so 
they  can  show  veteran  participants  that  the  forms  were  indeed  submitted. 
Standards  for  Internal  Control  in  the  Federal  Government  call  for 
agencies  to  have  control  over  information  processing  and  have  accurate 
and  timely  recording  of  transactions  and  events.58 

VA’s  strategic  plan  includes  a  goal  to  manage  and  improve  VA  operations 
to  deliver  seamless  and  integrated  support,59  but  overall,  66  of  the  156 
veterans  who  responded  to  our  survey  and  received  Post-9/1 1  Gl  Bill 
benefits  for  OJT  or  apprenticeship  programs  said  their  benefits  were  not 
always  received  on  time.  One  veteran  reported: 


58GAO/AIMD-00-21 .3.1 

59Department  of  Veterans  Affairs,  Department  of  Veterans  Affairs  FY  2014-2020  Strategic 
Plan. 
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“The  Gl/Bill  OJT  program  is  beneficial  to  me,  but  only  when  I  received  my  benefits.  In  the 
past  year,  only  3  to  4  months  [of  benefits]  have  been  ‘on  time.’  I’m  currently  waiting  on  4 
months’  worth  of  benefits.  I  personally  am  struggling  with  bills  and  I  know  many  others  are 
too...  That  is  the  biggest  concern...  that  our  paperwork  gets  ‘lost’  for  months  on  end.” 

In  addition,  6  of  28  veterans  we  interviewed  said  that  their  payments  had 
sometimes  been  delayed,  and  they  noted  that  these  delays  had  strained 
their  finances.  For  example,  one  veteran  who  responded  to  our  survey 
reported  that: 

“It  takes  too  long  for  the  VA  to  process  the  paperwork,  and  there  really  is  no  easy  way  to 
correct  mistakes  if  they  happen.  This  delays  payment  and  causes  bills  to  pile  up.” 

An  employer  reported: 

“There  is  no  communication  between  the  VA  and  us.  If  there  is  a  problem  with  the 
application,  the  VA  does  not  let  us  know  if  there  are  any  problems,  and  the  veteran  has  to 
wait  for  his  or  her  application  to  be  processed.” 

Similarly,  one  veteran  reported: 

“It  was  extremely  difficult  to  get  everything  to  and  from  everybody  that  needed  paperwork. 
It  took  over  a  year  after  I  started  the  program  to  get  all  of  the  things  needed  to  the  right 
people....  It  was  a  very  frustrating  process,  [and]  if  I  was  not  persistent,  I  could  have  given 
up.” 

VA  officials  told  us  delays  sometimes  occur  because  a  veteran’s  benefit 
application  is  received  before  the  employer  has  been  approved  or 
because  not  all  required  paperwork  has  been  submitted.  VA  officials  also 
told  us  that  they  are  in  the  process  of  developing  a  new  data  system 
called  Veterans  Approval,  Certification,  Enrollment,  Reporting  and 
Tracking  System  (VA-CERTS),  which  will  combine  and  replace  the 
program  certification  for  educational  institutions,  and  monthly  certification 
and  claims  processing  functions  currently  housed  in  two  separate 
systems.  Officials  indicated  that  VA-CERTS  will  include  the  program 
certification  and  monthly  hours  certification,  as  well  as  claim  processing 
for  the  OJT  and  apprenticeship  programs.  According  to  officials,  VA- 
CERTS  is  in  the  early  stage  of  development.  Specifically,  the  business 
requirements  document  to  build  the  new  system  was  completed  in  July 
2015  and  delivered  to  VA’s  Office  of  Information  and  Technology.  It 
includes  the  requirements  for  the  OJT  and  apprenticeship  elements 
mentioned  above.  Officials  told  us  that  funding  to  develop  VA-CERTS  has 
been  identified,  though  final  implementation  of  the  new  system  may  not 
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occur  until  at  least  2017.  In  the  interim,  absent  efforts  to  ease  the 
administrative  challenges  associated  with  submitting  monthly  paperwork, 
some  employers  and  veterans  are  likely  to  continue  to  experience 
difficulties  and  delays.  Such  efforts  to  ease  the  administrative  challenges 
could  include  allowing  employers  and  apprenticeship  sponsors  to  submit 
monthly  certification  forms  by  email,  or  providing  confirmation  that 
monthly  forms  have  been  received. 


Little  Is  Known  about 
the  Performance  of 
VA’s  OJT  and 
Apprenticeship 
Programs 


VA  has  not  established  outcome  measures  to  report  on  the  performance 
of  Post-9/11  Gl  Bill  OJT  and  apprenticeship  participants.  Specifically,  VA 
does  not  measure  such  outcomes  as  whether  participants  retained 
employment  or  experienced  earnings  gains  after  completing  the  program. 
As  previously  mentioned,  VA  officials  indicated  that  there  is  no 
requirement  for  VA  to  measure  OJT  and  apprenticeship  performance. 
However,  standards  for  internal  control  call  for  establishing  and  reviewing 
performance  measures  to  allow  an  agency  to  evaluate  relevant  data  and 
take  appropriate  actions.60  Moreover,  a  recent  review  by  the  Vice 
President  concluded  that  an  integral  element  of  successful  job  training 
programs  is  measuring  outcomes  for  all  participants  and  informing 
participants  and  employers  of  the  results.61  The  Vice  President’s  report 
noted  the  importance  of  tracking  outcomes  such  as  employment  retention 
and  earnings  gains  so  participants  can  choose  training  options  wisely — 


VA  Does  Not  Measure 
Outcomes  for  Participants 
in  the  Post-9/11  Gl  Bill 
OJT  and  Apprenticeship 
Programs 


60GAO/AIMD-O0-21 .3.1 

61ln  2014,  the  President  issued  a  Presidential  Memorandum  on  job-driven  training  for 
workers.  This  memorandum  tasked  a  Cabinet  team,  led  by  the  Vice  President,  to  issue  a 
report  within  180  days  outlining  a  plan  to  make  America’s  workforce  and  training  system 
more  job-driven,  integrated,  and  effective.  The  subsequent  report  was  issued  in  July  2014. 
The  White  House,  Ready  to  Work:  Job-Driven  Training  and  American  Opportunity 
(Washington,  D.C.:  2014). 
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and  so  programs  can  improve  performance.62  Additionally,  VA  officials 
told  us  that  having  access  to  data  on  participant  outcomes  could  help 
them  promote  the  programs  to  employers  and  veterans. 

According  to  VA  officials,  the  agency  lacks  a  data  mechanism  and 
resources  for  measuring  employment  outcomes  once  veterans  have 
exhausted  their  Post-9/11  Gl  Bill  benefits.  States’  Unemployment 
Insurance  wage  records,  which  DOL  uses  to  measure  outcomes  for  its 
OJT  and  apprenticeship  programs,  are  one  possible  data  source  VA 
could  explore  to  measure  outcomes  for  participating  veterans.  According 
to  DOL  officials,  VA  could  consult  with  DOL  to  determine  if  it  could  access 
this  data  source  through  the  Wage  Records  Interchange  System  2  (WRIS 
2). 63  VA  officials  told  us  they  had  not  previously  considered  participating 
in  WRIS  2  to  access  wage  records,  and  consequently  have  not 
considered  if  they  need  to  seek  legislative  authority  to  do  so.  In  addition 
to  this  shared  resource,  other  mechanisms  for  measuring  outcomes  could 
potentially  be  developed,  such  as  collecting  outcome  data  directly  from 
employers  and  apprenticeship  sponsors. 

Although  VA  does  not  measure  outcomes  for  OJT  and  apprenticeship 
programs,  it  does  collect  and  report  data  for  some  outcome  measures  for 
the  higher  education  portions  of  the  Post-9/11  Gl  Bill.  Specifically,  VA 
collects  and  publicly  reports  data  for  Gl  Bill  participants  on  such 
measures  as  graduation  rates  and  loan  default  rates.  VA  officials  also 
indicated  that  they  plan  to  report  on  transfer  rates  and  employment 
retention  rates,  among  other  measures,  for  graduates  of  higher  education 
programs.  This  effort  was  a  product  of  a  2012  Executive  Order  that  called 
for  the  Secretaries  of  Defense,  Veterans  Affairs,  and  Education  to 
develop  such  outcome  measures  to  help  veterans  make  informed 
decisions  about  how  to  use  their  Gl  Bill  benefits.64  VA  officials  told  us  that 


62The  Vice  President’s  report  included  a  checklist  of  items  that  agencies  should  follow  in 
reforming  the  administration  of  their  job  training  programs. 

63As  noted  previously,  WRIS  2  has  a  policy  of  sharing  wage  records  with  federal  or  state 
agencies  operating  other  programs  outside  of  DOL,  but  only  if  those  agencies  are  required 
by  law  to  meet  performance  measures.  As  a  result,  VA  may  not  currently  be  able  to  utilize 
this  shared  data  resource. 

64Exec.  Order  No.  13,607,  77  Fed.  Reg.  25,861  (May  2,  2012).  VA  is  also  required  by 
statute  to  report  each  year  on  the  operation  of  the  Post-9/1 1  Gl  Bill  program,  including 
appropriate  student  outcome  measures,  such  as  number  of  credit  hours,  certificates, 
degrees  and  other  qualifications  earned  by  participants.  38  U.S.C.  §  3325(a)  and  (c)(2). 
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even  though  they  currently  have  no  plans  to  develop  or  report  on  similar 
post-program  performance  measures  for  OJT  and  apprenticeship 
participants,  they  recognize  the  importance  of  such  an  effort. 

State  officials  we  surveyed  and  employers  and  apprenticeship  sponsors 
who  have  participated  in  the  OJT  and  apprenticeship  programs  and 
responded  to  our  nongeneralizable  survey  generally  said  the  programs 
promote  employment  retention  and  effectively  serve  veterans.  Of  the  44 
SAAs  we  surveyed,  officials  from  38  said  they  believed  the  programs 
were  generally  either  very  or  somewhat  effective  in  improving  veterans’ 
employment  prospects  (see  table  8).  Additionally,  of  the  153  participating 
employers  and  apprenticeship  sponsors  who  responded  to  our  survey, 
128  said  that,  in  their  experience,  veteran  participants  typically  continued 
to  work  in  the  same  area  for  which  they  received  training  while  in  the 
programs.65  Nevertheless,  without  establishing  and  reporting  data  on 
outcome  measures  for  these  programs,  VA  will  not  be  able  to  verify 
whether  these  perceptions  are  accurate  and  know  how  well  these 
programs  are  performing. 


Table  8:  SAA  Survey  Responses  Regarding  Perceived  Effectiveness  of  the  On-the- 

Job  (OJT)  and  Apprenticeship  Programs  in  Improving  Veterans’  Employment 
Prospects 

Response  Number  of  SAAs  with  this  response 

Very  effective 

23 

Somewhat  effective 

15 

Neither  effective  nor  ineffective 

0 

Somewhat  ineffective 

1 

Very  ineffective 

1 

Don’t  know 

4 

Source:  GAO  survey  of  State  Approving  Agency  Directors  in  44  states.  |  GAO-16-51 


650f  the  remaining  25  respondents,  7  said  that  in  their  experience  veterans  participating  in 
the  program  did  not  generally  continue  to  work  in  the  area  for  which  they  received  training, 
while  1 7  indicated  they  did  not  know,  and  1  did  not  answer  the  question. 
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Data  on  DOL  Programs 
Indicate  Potential  for 
Positive  Employment 
Outcomes  for  OJT  and 
Apprenticeship  Models 


DOL  collects  performance  data  for  its  OJT  services  and  Registered 
Apprenticeship  program,  and  these  data  suggest  that  OJT  and 
apprenticeship  training  models  can  be  associated  with  positive  outcomes 
for  measures  such  as  employment  retention  and  earnings  gains. 
According  to  2013  DOL  program  data,  85  percent  of  Post-9/1 1-era 
veterans  who  received  OJT  services  entered  employment  within  3 
months  of  completing  their  training,  and  86  percent  of  these  veterans 
retained  employment  over  the  subsequent  6  months.  Additionally,  Post- 
9/11 -era  veterans  who  used  OJT  services  earned  25  percent  more  in  the 
second  and  third  quarters  after  finishing  their  OJT  services  than  they  had 
earned  prior  to  receiving  services. 

While  these  data  indicate  the  potential  for  positive  employment  outcomes 
for  an  OJT  approach  to  training,  they  do  not  necessarily  reflect  outcomes 
for  veterans  in  VA’s  programs.  As  previously  mentioned,  DOL’s  OJT 
services  and  the  Post-9/1 1  Gl  Bill  OJT  program  differ  in  several  key  ways. 
First,  while  all  veterans  who  served  for  at  least  90  days  after  Sept.  1 1 , 
2001,  are  entitled  to  Post-9/11  Gl  Bill  benefits,  American  Job  Center  staff 
must  determine  that  DOL  OJT  participants — civilians  and  veterans  alike — 
need  additional  services  to  obtain  employment.  Second,  whereas 
veterans  receive  Post-9/1 1  Gl  Bill  benefits  in  the  form  of  a  monthly  benefit 
payment,  DOL  OJT  benefits  are  paid  to  employers  in  the  form  of  a  wage 
subsidy.  The  subsidy  covers  the  costs  of  training  services  needed  to  help 
participants  gain  or  retain  employment.  Third,  the  Post-9/1 1  Gl  Bill  OJT 
programs  are  limited  in  duration  to  6  to  24  months,  while  the  duration  of 
subsidized  DOL  OJT  services  varies  according  to  the  needs  of  the 
position  and  the  availability  of  local  workforce  funds. 

Outcome  data  and  available  research  on  DOL’s  Registered 
Apprenticeship  program  also  point  to  the  potential  for  employment 
benefits  of  an  apprenticeship  training  model.  DOL  reports  outcome 
measures  for  all  Registered  Apprenticeship  participants,  without 
distinguishing  participants  by  veteran  status.  Nevertheless,  2014  program 
data  show  that  91  percent  of  participants  who  completed  the  DOL 
program  found  employment  within  3  months  compared  to  76  percent  of 
those  who  exited  the  program  without  completing  it.  Of  those  individuals 
who  completed  the  program  and  found  employment  within  3  months,  91 
percent  retained  their  employment  over  the  subsequent  6  months.  DOL 
data  also  indicate  that  the  average  wages  of  apprentices  who  completed 
the  program  increased  about  65  percent  from  $13.78  per  hour  to  $22.69 
per  hour  during  the  course  of  the  program.  Moreover,  a  study 
commissioned  by  DOL  estimated  that  those  individuals  who  completed  a 
Registered  Apprenticeship  earned  substantially  more  over  a  career  than 
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similar  individuals  who  did  not  complete  a  Registered  Apprenticeship.66  It 
is  important  to  note  that  some  of  these  earnings  gains  are  likely  due  to 
unobserved  differences  between  those  individuals  who  completed  a 
Registered  Apprenticeship  and  those  individuals  who  did  not.67 

As  with  OJT  services,  outcomes  associated  with  DOL’s  Registered 
Apprenticeship  do  not  necessarily  reflect  the  outcomes  for  veterans  in 
Post-9/11  Gl  Bill  apprenticeship  programs.  First,  DOL  does  not 
differentiate  veterans  from  nonveterans  in  its  Registered  Apprenticeship 
outcomes;  the  reported  data  refer  to  the  entire  population  of  those  who 
either  complete  or  exit  a  Registered  Apprenticeship.  It  is  therefore  not 
possible  to  use  these  data  to  determine  how  effectively  Registered 
Apprenticeships  are  serving  Post-9/1 1 -era  veterans.  Second,  these  data 
reflect  outcomes  in  the  25  states  in  which  DOL’s  Office  of  Apprenticeship 
administers  the  Registered  Apprenticeship  program.68  Therefore, 
Registered  Apprenticeship  outcome  data  from  DOL  do  not  represent 
nationwide  participant  outcomes.  Absent  measures  for  VA’s  OJT  and 
apprenticeship  programs,  the  performance  of  these  programs  will  remain 
unknown. 


Conclusions 


While  many  veterans  benefit  from  higher  education  after  their  military 
service  ends,  for  some  veterans  it  may  not  be  the  ideal  career  path  to 
successfully  attain  civilian  jobs.  Given  the  wide  range  of  education  and 
training  options  available  under  the  Post-9/11  Gl  Bill,  it  is  important  that 
veterans  be  fully  aware  of  their  options  so  they  can  make  an  informed 
decision  about  how  to  use  their  benefits  to  effectively  transition  to  civilian 
life.  Most  Post-9/1 1  Gl  Bill  outreach  materials  emphasize  higher 


66Debbie  Reed  et  al. ,  An  Effectiveness  Assessment  and  Cost-Benefit  Analysis  of 
Registered  Apprenticeship  in  10  States  (Oakland,  Calif.:  Mathematica  Policy  Research, 
2012). 

67We  found  that  the  Mathematica  study’s  statistical  approaches  were  generally 
appropriate.  However,  the  study  did  not  control  for  potentially  unobserved  differences 
between  the  populations,  which  could  explain,  in  part,  why  some  individuals  who  complete 
Registered  Apprenticeships  earn  more,  rather  than  reflect  the  impact  of  the  apprenticeship 
itself. 

68DOL’s  Office  of  Apprenticeship  (OA)  administers  the  approval  process  and  other 
administrative  functions  for  Registered  Apprenticeship  programs  in  25  states,  while  State 
Apprenticeship  Agencies  fill  this  role,  in  adherence  to  federal  Registered  Apprenticeship 
standards,  in  the  remaining  25  states. 
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education  programs,  and  most  state  officials  we  surveyed  told  us  that 
awareness  of  OJT  and  apprenticeship  opportunities  is  low.  While  VA 
provides  some  information  about  OJT  and  apprenticeship  programs, 
many  veterans  and  employers  learn  about  the  program  through  word-of- 
mouth  rather  than  through  systematic  outreach  efforts.  Without  improved 
program  outreach,  veterans  who  could  benefit  from  these  programs  may 
remain  unaware  of  them  and  could  miss  opportunities  to  improve  their 
long-term  employment  prospects,  consistent  with  agency  goals. 

Overall,  veterans,  employers,  and  state  officials  we  contacted  were 
generally  positive  about  VA’s  OJT  and  apprenticeship  programs. 

However,  many  suggested  that  VA’s  current,  paper-based  system  for 
paying  monthly  benefits  is  inefficient,  leading  to  administrative  burdens  for 
employers  and  delayed  benefit  payments  for  veterans — adding  economic 
stress  for  veterans  who  are  counting  on  this  assistance.  VA  has  taken  a 
first  step  towards  easing  these  administrative  challenges  by  deciding  to 
incorporate  the  OJT  and  apprenticeship  programs  into  its  development  of 
the  new  VA-CERTS  data  system  to  process  program  approvals  and 
benefit  payments.  However,  this  system  may  not  be  implemented  until  at 
least  2017,  and  increasing  numbers  of  veterans  will  become  eligible  for 
Post-9/11  OJT  and  apprenticeship  benefits  as  the  military  continues  to 
draw  down  its  forces.  In  the  interim,  and  in  the  absence  of  efforts  to  ease 
administrative  challenges  for  employers  who  experience  difficulty  in 
submitting  monthly  certifications  and  for  veterans  who  experience 
delayed  payments,  some  veterans  will  likely  continue  to  experience 
delayed  payments.  Such  delays  can  undermine  one  of  the  primary 
benefits  of  the  program  cited  by  participants:  helping  veterans  cover  living 
expenses  while  transitioning  to  the  civilian  workforce. 

With  regard  to  performance,  outcome  data  collected  by  DOL  on  the  OJT 
and  apprenticeship  programs  it  administers  indicate  the  potential  for 
positive  employment  outcomes  for  these  training  models.  However,  VA  is 
limited  in  its  ability  to  assess  the  impact  of  its  Post-9/1 1  Gl  Bill  OJT  and 
apprenticeship  programs  on  veterans  because  VA  does  not  measure 
performance  outcomes  for  participants.  While  VA  has  undertaken  efforts 
to  better  measure  and  report  outcomes  in  its  higher  education  programs, 
the  agency  currently  has  no  plans  to  do  so  for  its  OJT  and  apprenticeship 
programs.  Without  measuring  and  reporting  on  outcomes  for  these 
programs,  VA  will  not  be  able  to  assess  their  effectiveness,  and  veterans 
may  not  be  well-positioned  to  determine  which  programs  are  most 
suitable  for  them  when  choosing  how  to  use  their  benefits. 
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Recommendations  for 
Executive  Action 


2.  To  help  address  challenges  veterans  and  employers  reported  facing 
in  using  the  OJT  and  apprenticeship  programs,  the  Secretary  of  VA 
should  identify  and  implement  cost-effective  steps  to  ease 
administrative  challenges  in  submitting  paperwork  or  receiving 
payments  as  the  new  automated  VA-CERTS  system  to  process 
program  approvals  and  benefit  payments  is  being  developed  and 
implemented. 

3.  To  increase  accountability  for  program  performance,  the  Secretary  of 
VA  should  establish  measures  to  report  on  program  outcomes  for 
Post-9/11  Gl  Bill  OJT  and  apprenticeship  programs,  including 
considering  relevant  data  sources  and  seeking  legislative  authority  to 
gain  access  to  data,  if  necessary. 


We  are  making  the  following  three  recommendations: 

1 .  To  help  ensure  that  veterans  are  aware  of  the  Post-9/1 1  OJT  and 
apprenticeship  programs  so  they  can  make  informed  decisions  about 
how  they  use  their  benefits,  the  Secretary  of  VA  should  identify  and 
implement  appropriate,  cost-effective  actions  to  increase  awareness 
of  OJT  and  apprenticeship  benefits  under  the  Post-9/11  Gl  Bill. 


Agency  Comments 


We  provided  a  draft  of  this  report  to  VA,  DOL,  and  DOD  for  comment.  VA 
provided  written  comments  that  are  reproduced  in  appendix  II.  Neither 
DOD  nor  DOL  provided  a  formal  response.  In  addition,  VA  and  DOL 
provided  technical  comments  that  we  incorporated  as  appropriate. 

VA  agreed  with  each  of  our  three  recommendations.  In  response  to  our 
recommendation  to  increase  awareness  of  OJT  and  apprenticeship 
benefits  under  the  Post-9/1 1  Gl  Bill,  VA  said  it  will  develop  a  guide  for 
employers  and  apprenticeship  sponsors  about  Post-9/11  Gl  Bill  OJT  and 
apprenticeship  benefits.  VA  also  said  it  will  publicize  this  guide  and  make 
it  available  on  VA’s  Gl  Bill  website.  Further,  VA  said  it  will  send  veterans 
and  stakeholders  information  on  OJT  and  apprenticeship  benefits  via  an 
email  blast  and  by  posting  information  to  the  Employment  Center  section 
of  VA’s  eBenefits  website.  In  response  to  our  recommendation  to  ease 
administrative  challenges  in  submitting  paperwork  or  receiving  payments 
while  the  new  automated  VA-CERTS  system  is  being  developed  and 
implemented,  VA  said  it  will  explore  the  feasibility  of  cost-effective  options 
and  will  develop  a  plan  to  ease  challenges.  Finally,  in  response  to  our 
recommendation  to  establish  measures  to  report  on  program  outcomes, 
VA  agreed  that  program  performance  metrics  should  be  developed  to 
report  on  program  outcomes.  VA  said  it  will  develop  a  plan  to  determine 
the  feasibility  of  collecting  and  publishing  program  outcome  data  for  the 
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OJT  and  apprenticeship  programs.  VA  set  a  target  completion  date  of 
June  2016  for  all  actions  set  forth  in  its  response  to  our 
recommendations. 


We  are  sending  copies  of  this  report  to  the  appropriate  congressional 
committees  and  the  Secretaries  of  Veterans  Affairs,  Labor,  and  Defense. 
In  addition,  the  report  is  available  at  no  charge  on  the  GAO  website  at 

http://www.gao.gov. 

If  you  or  your  staff  has  any  questions  about  this  report  please  contact  me 
at  (202)  512-7215  or  sherrilla@gao.gov.  Contact  points  for  our  Offices  of 
Congressional  Relations  and  Public  Affairs  may  be  found  on  the  last  page 
of  this  report.  GAO  staff  who  made  key  contributions  to  this  report  are 
listed  in  Appendix  III. 


Andrew  Sherrill, 

Director,  Education,  Workforce,  and  Income  Security 
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Appendix  I:  Objectives,  Scope,  and 
Methodology 


In  conducting  our  review  of  the  Department  of  Veterans  Affairs  (VA)  Post- 
9/11  Gl  Bill  on-the-job  training  (OJT)  and  apprenticeship  programs,  our 
objectives  were  to  examine  (1)  how  selected  veterans  and  employers 
used  the  programs  and  how  widely  they  have  been  used,  (2)  to  what 
extent  VA  and  states  have  taken  steps  to  inform  veterans  and  employers 
about  these  programs,  (3)  what  challenges,  if  any,  veterans  and 
employers  have  faced  in  using  them,  and  (4)  to  what  extent  VA  has 
assessed  the  performance  and  effectiveness  of  its  programs.  This 
appendix  provides  a  detailed  account  of  the  data  sources  used  to  answer 
these  questions,  the  analyses  we  conducted,  and  any  limitations  we 
encountered. 

We  conducted  this  performance  audit  from  August  2014  to  November 
2015  in  accordance  with  generally  accepted  government  auditing 
standards.  These  standards  require  that  we  plan  and  perform  the  audit  to 
obtain  sufficient,  appropriate  evidence  to  provide  a  reasonable  basis  for 
our  findings  and  conclusions  based  on  our  audit  objectives.  We  believe 
that  the  evidence  obtained  provides  a  reasonable  basis  for  our  findings 
and  conclusions  based  on  our  audit  objectives. 


Analysis  Of  VA  To  describe  how  widely  the  OJT  and  apprenticeship  programs  have  been 

Administrative  Data  used,  we  requested  and  analyzed  program  data  from  VA.  VA  provided 

information  from  two  different  databases — the  Long  Term  Solution  (LTS) 
database  and  the  Web  Enabled  Approval  Management  System 
(WEAMS).  We  assessed  the  reliability  of  these  data  by  reviewing  existing 
information  about  the  data  and  the  systems  that  produced  them  and  by 
interviewing  agency  officials  knowledgeable  about  the  data.  We 
determined  that  the  data  were  sufficiently  reliable  for  the  purposes  of  this 
report.  The  summary  statistics  that  VA  provided  from  its  LTS  data 
included  the  number  of  veterans  who  have  participated  in  the  OJT  and 
apprenticeship  programs  since  these  benefits  first  became  available  on 
Oct.  1 , 201 1 ,  and  the  number  of  veterans  participating  in  other  Post-9/1 1 
Gl  Bill  programs  through  March  23,  2015 — the  most  recent  data  available 
at  the  time  VA  analyzed  them.  In  addition,  VA  provided  summary 
information  from  the  WEAMS  dataset  as  of  March  23,  2015  on  the 
number  of  facilities  (employers  or  apprenticeship  sponsors)  that  have 
been  approved  to  provide  OJT  or  apprenticeship  training  opportunities 
under  the  Post-9/11  Gl  Bill.  VA  also  provided  selected  participant-level 
information  from  the  LTS  dataset  that  we  analyzed  to  describe  key 
demographic  characteristics  of  the  participant  population,  including 
average  age  and  the  percentage  of  participants  by  program  type,  gender, 
and  branch  of  service.  We  also  used  this  data  source  to  identify 
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occupations  for  which  veterans  frequently  train  while  participating  in  the 
Post-9/11  OJT  and  apprenticeship  programs. 


Analysis  of  DOL  To  provide  information  on  what  is  known  about  the  effectiveness  of  OJT 

Administrative  Data  services  and  Registered  Apprenticeship  programs  in  serving  Post-9/1 1- 

era  veterans,  we  reviewed  available  data  sources  from  DOL,  as  VA  does 
not  have  performance  data  on  Gl  Bill  OJT  and  apprenticeship  programs. 
First,  we  examined  a  publicly-available  performance  data  guide  for  the 
Workforce  Investment  Act  Standardized  Record  Data  (WIASRD)  from 
program  year  2012  to  determine  what  data  elements  we  would  request 
for  Post-9/1 1 -era  veteran  participants  in  DOL’s  OJT  services.  We  then 
requested  and  analyzed  DOL  aggregate  outcome  data  from  the  fourth 
quarter  of  program  year  2013,  which  included  program  exiters  from  prior 
quarters  of  that  year,  on:  1 )  the  rate  at  which  participants  enter 
employment  during  the  first  quarter  after  their  OJT  services;  2)  the  rate  at 
which  participants  retain  employment  during  the  second  and  third 
quarters  after  their  OJT  services;  3)  average  quarterly  earnings  for 
participants  during  the  quarter(s)  before  their  OJT  services;  and  4) 
average  quarterly  earnings  for  participants  across  the  second  and  third 
quarters  after  their  OJT  services.1  Per  our  request,  these  data  were 
presented  by  veteran  status  and  included  outcomes  for  Post-9/1 1  -era 
veterans  specifically.  In  order  to  verify  the  reliability  of  the  data,  we 
interviewed  data  specialists  at  DOL  and  requested  and  evaluated 
supporting  documentation  regarding  the  data  source.  We  determined  that 
the  data  were  sufficiently  reliable  for  the  purposes  of  this  report. 

We  also  reviewed  available  DOL  data  on  the  Registered  Apprenticeship 
program  in  order  to  provide  some  information  on  the  effectiveness  of 
apprenticeships  in  serving  Post-9/1 1 -era  veterans.  Specifically,  we 
examined  the  Registered  Apprenticeship  Partners  Information 
Management  Data  System  (RAPIDS),  which  contains  Registered 
Apprenticeship  participant  information  from  states  whose  programs  are 
administered  by  DOL’s  Office  of  Apprenticeship  within  the  Employment 


States  are  required  to  report  a  series  of  common  performance  measures  to  DOL  for  adult 
training  programs,  including  OJT  services,  using  their  Unemployment  Insurance  wage 
records  databases.  29  U.S.C.  3141(d).  These  common  measures,  such  as  the 
employment  retention  rate  and  average  earnings,  are  reported  on  a  quarterly  basis.  DOL 
submitted  data  for  these  measures  from  the  fourth  quarter  of  program  year  2013. 
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and  Training  Administration  (ETA),  as  well  as  individual  states  that  have 
agreed  to  report  data  nationally.2 

Through  a  data  sharing  agreement  with  participating  states,  DOL’s  Office 
of  Apprenticeship  assesses  outcome  measures  quarterly,  according  to 
DOL  officials,  using  states’  Unemployment  Insurance  wage  records.  We 
analyzed  the  same  aggregate  performance  data  from  RAPIDS  as  we 
requested  data  for  OJT  services  from  2014,  the  most  recent  year  from 
which  DOL  could  provide  data.  However,  DOL  officials  noted  that 
Registered  Apprenticeship  outcomes  data  are  not  categorized  by  veteran 
status  and  do  not  include  pre-program  earnings.  We  also  interviewed 
officials  from  the  Office  of  Apprenticeship  to  verify  data  reliability  and 
requested  and  evaluated  supporting  documentation  regarding  the  data 
source.  We  determined  that  the  data  were  sufficiently  reliable  for  the 
purposes  of  this  report. 


Participating  Veteran  To  learn  about  how  selected  veterans  have  used  the  Post-9/1 1  Gl  Bill 

Survey  CUT  or  apprenticeship  programs  and  what  challenges  they  may  have 

faced,  we  conducted  a  web-based  survey  of  veterans  who  have 
participated  in  these  programs.  We  limited  our  in-scope  population  to 
those  veterans  for  which  VA  was  able  to  provide  email  addresses. 
Specifically,  while  VA  provided  detailed  participant  level  information  on 
26,375  unique  participating  veterans,  we  drew  our  sample  from  the 
12,01 1  veterans  for  which  email  addresses  were  provided.  As  a  result, 
the  results  of  this  survey  are  not  generalizable  to  the  population  of 
participating  veterans.  To  generate  the  original  sample,  participants  were 
selected  in  a  probability  sample  stratified  by  gender.  The  sample  size  was 
calculated  to  allow  us  to  produce  generalizable  estimates  having  95 
percent  confidence  intervals  no  larger  than  plus  or  minus  10  percent  for 
the  overall  sample  size  of  200,  assuming  a  response  rate  of  50  percent. 
Of  this  original  sample  of  200  participants,  20  participants  were  women 
and  180  were  male  or  no  gender  identified.  Due  to  lower  than  expected 
response  rates,  we  decided  to  select  an  additional  sample  so  that  we 


2The  Registered  Apprenticeship  program  (29  C.F.R.  pt.  29)  is  a  party  to  the  Wage 
Records  Interchange  System,  an  agreement  between  DOL’s  Employment  and  Training 
Administration  and  participating  states  that  facilitates  the  interstate  exchange  of  wage  data 
for  purposes  of  assessing  and  reporting  on  the  performance  of  programs  authorized  under 
WIA.  Federal  and  state  agencies  with  performance  reporting  requirements  for  specified 
programs  outside  of  WIA,  including  the  Registered  Apprenticeship  program,  may  also 
submit  requests  for  aggregate  wage  records  data  from  participating  states. 


Page  45 


GAO-16-51  VA  Benefits 


Appendix  I:  Objectives,  Scope,  and 
Methodology 


could  receive  more  responses,  even  though  the  results  of  the  survey 
would  not  be  generalizable.  Specifically,  the  survey  was  sent  to  an 
additional  sample  of  5,000  participating  veterans,  500  of  whom  were 
women  and  4,500  of  whom  were  male  or  no  gender  identified. 
Consequently,  the  survey’s  final  sample  size  was  5,200  participating 
veterans.  Prior  to  fielding  the  survey,  we  conducted  4  pretests  to  ensure 
that  the  questions  were  clear,  comprehensive,  did  not  introduce  bias,  and 
were  not  burdensome  to  complete.  We  made  minor  revisions  to  the 
survey  instrument  based  upon  these  pretests.  We  launched  the  web- 
based  survey  on  June  1 1 , 201 5,  and  sent  two  follow-up  emails  to 
sampled  veterans  on  June  17  and  June  24,  2015.  We  made  the  web- 
based  sample  available  to  the  additional  5,000  sampled  veterans  on  July 
9,  2015  and  sent  a  follow-up  email  to  all  nonrespondents  on  July  15, 

201 5.  We  closed  the  survey  on  July  31 ,  2015.  Overall,  GAO  received 
responses  from  156  participating  veterans — a  3  percent  response  rate. 


Non-participating  Veteran 
Survey 


To  learn  to  what  extent  selected  veterans  who  have  used  Post-9/1 1  Gl 
Bill  benefits  to  pursue  a  non-college  degree  program,  such  as  vocational 
school,  but  who  have  not  participated  in  the  apprenticeship  or  OJT 
programs,  were  aware  of  these  programs,  we  conducted  a  web-based 
survey  of  such  veterans.  We  limited  our  in-scope  population  to  those 
veterans  for  which  VA  was  able  to  provide  email  addresses.  Specifically, 
while  VA  provided  detailed  participant  level  information  on  145,525 
unique  veterans  who  had  used  their  Post-9/1 1  Gl  Bill  benefits  for  a  non¬ 
college  degree  program,  we  drew  our  sample  from  the  70,695  veterans 
for  whom  email  addresses  were  provided.  To  generate  the  original 
sample,  150  veterans  who  did  not  participate  in  OJT  or  apprenticeship 
were  drawn  from  the  population  of  veterans  who  had  used  their  Post-9/11 
Gl  Bill  benefits  for  a  non-college  degree  program  and  for  which  email 
addresses  were  available.  We  assumed  a  20  percent  response  rate  for 
this  population.  Due  to  lower  than  expected  response  rates,  we  decided 
to  select  an  additional  sample  so  that  we  could  receive  more  responses, 
even  though  the  results  of  the  survey  would  not  be  generalizable. 
Specifically,  the  survey  was  sent  to  an  additional  sample  of  5,000  non¬ 
participating  veterans.  Consequently,  the  survey’s  final  sample  size  was 
5,150  veterans.  Prior  to  fielding  the  survey,  we  conducted  2  pretests  to 
ensure  that  the  questions  were  clear,  comprehensive,  did  not  introduce 
bias,  and  were  not  burdensome  to  complete.  We  made  minor  revisions  to 
the  survey  instrument  based  upon  these  pretests.  We  launched  the  web- 
based  survey  on  June  10,  2015  and  sent  follow-up  emails  to  sampled 
veterans  on  June  17  and  June  24,  2015.  We  made  the  web-based 
sample  available  to  the  additional  5,000  sampled  veterans  on  July  8, 
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2015  and  sent  a  follow-up  email  to  all  non-respondents  on  July  16,  2015. 
We  closed  the  survey  on  Aug.  3,  2015.  Overall,  we  received  responses 
from  127  non-participating  veterans — a  2.5  percent  response  rate.  Given 
the  low  response  rate,  the  findings  of  this  survey  are  not  generalizable. 


Employer  and 
Apprenticeship  Sponsor 
Survey 


To  learn  about  how  selected  employers  and  apprenticeship  sponsors 
have  used  the  Post-9/1 1  Gl  Bill  OJT  or  apprenticeship  programs  and 
what  challenges  they  may  have  faced,  we  conducted  a  web-based  survey 
of  employers  and  apprenticeship  sponsors  who  have  participated  in  these 
programs.  We  limited  our  in  scope  population  to  those  employers  and 
apprenticeship  sponsors  for  which  VA  was  able  to  provide  email 
addresses.  Specifically,  while  VA  provided  detailed  information  on  5,099 
unique  participating  employers  and  apprenticeship  sponsors,  we  drew  our 
sample  from  the  2,691  employers  and  apprenticeship  sponsors  for  which 
email  addresses  were  provided.  To  generate  the  original  sample,  600 
employers  and  apprenticeship  sponsors  were  selected  in  a  simple 
random  sample.  The  sample  size  was  calculated  assuming  a  response 
rate  of  5  percent,  and  included  7  employers  and  apprenticeship  sponsors 
who  had  completed  questionnaires  during  our  site  visit  to  North  Carolina. 
Prior  to  fielding  the  survey,  we  conducted  3  pretests  to  ensure  that  the 
questions  were  clear,  comprehensive,  did  not  introduce  bias,  and  were 
not  burdensome  to  complete.  We  made  minor  revisions  to  the  survey 
instrument  based  upon  these  pretests.  We  launched  the  web-based 
survey  on  June  1 1 , 201 5  and  sent  follow-up  emails  to  sampled  employers 
and  apprenticeship  sponsors  on  June  17  and  July  9,  2015.  GAO  closed 
the  survey  on  July  24,  2015.  Overall,  GAO  received  responses  from  153 
participating  employers  and  apprenticeship  sponsors — a  25  percent 
response  rate.  The  findings  of  this  survey  are  not  generalizable. 


State  Approving  Agency  To  learn  about  what  states  are  doing  to  help  veterans  and  employers  use 
(SAA)  Survey  the  Post-9/1 1  OJT  and  apprenticeship  programs,  as  well  as  gain  insight 

on  veterans’  and  employers’  use  of  these  programs  and  challenges  states 
faced,  we  emailed  a  MS  Word  questionnaire  to  SAA  officials  in  the  44 
states  in  which  these  officials  oversee  implementation  of  these 
programs.3  After  developing  our  questionnaire,  we  conducted  two 


According  to  VA,  VA  officials  implement  the  Post-9/11  Gl  Bill  OJT  and  apprenticeship 
programs  in  the  remaining  6  states  and  the  District  of  Columbia,  and  as  such,  we 
excluded  them  from  this  survey  effort. 
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pretests  with  state  officials  to  ensure  that  the  questions  were  clear, 
comprehensive,  did  not  introduce  bias,  and  were  not  burdensome  to 
complete.  We  made  minor  revisions  to  the  survey  instrument  based  upon 
these  pretests. 

The  survey  included  questions  about  methods  of  outreach  to  veterans 
and  employers,  assistance  to  employers,  challenges  to  veteran  and 
employer  outreach  and  participation,  and  challenges  with  SAA 
implementation  of  the  program.  It  also  included  questions  about  the  value 
or  interest  in  key  improvements,  such  as  automating  the  payment  system. 

We  sent  the  survey  by  email  in  March  and  April  2015  using  email 
addresses  from  the  National  Association  of  State  Approving  Agencies 
website.  We  followed-up  with  unresponsive  states  via  email  until  we 
reached  100  percent  participation  in  July  2015.  Survey  responses  were 
collected  using  a  Microsoft  Word  form  and  imported  into  Microsoft  Excel 
for  summary  and  analysis.  In  some  cases  a  state  official  sent  their 
response  in  another  type  of  file,4  and  we  transposed  responses  into  the 
Microsoft  Word  form  and  verified  that  the  responses  matched  the  state’s 
supplied  answers.  While  we  had  survey  responses  for  all  44  states,  in 
several  instances  a  state  did  not  supply  an  answer  for  a  single  question. 
For  summary  and  analysis  performed  on  those  questions  we  excluded 
those  states  from  the  denominator.  All  analyses  of  responses  were 
reviewed  and  verified  to  be  accurate. 


Review  of  Relevant  Laws, 
Regulations,  and  Other 
Documents 


To  learn  about  VA’s  implementation  of  the  OJT  and  apprenticeship 
programs  under  the  Post-9/1 1  Gl  Bill,  we  reviewed  relevant  provisions  of 
the  Post-9/1 1  Gl  Bill  and  related  regulations.  We  also  reviewed  the  Plain 
Writing  Act  of  2010,  a  law  related  to  the  public  dissemination  of 
information  on  benefits.5  In  addition,  we  reviewed  VA’s  Strategic  Plan  for 
2014  to  2020  to  understand  greater  agency  objectives,  and  other  federal 
best  practice  documents  such  as  the  Job  Driven  Checklist  in  the  Vice 
President’s  Ready  to  Work:  Job-Driven  Training  and  American 


4For  example,  several  states  emailed  us  a  PDF  copy  of  the  form  that  couldn’t  be  imported 
into  Microsoft  Excel. 

5Pub.  L.  No.  111-274,  §§  3(3)  and  4(b),  124  124  Stat.  2861, 2161-62  (codified  at  5  U.S.C. 
§  301  note). 
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Opportunity  report,  and  Standards  for  Internal  Control  in  the  Federal 
Government.6 


Analysis  of  VA  and  DOL  To  understand  VA  and  DOL  outreach  to  veterans  and  employers,  we 
Outreach  Materials  analyzed  key  sources  of  information  that  are  readily  available  regarding 

Post-9/11  OJT  and  apprenticeship  programs.  Specifically,  we  analyzed 
curriculum  documents  for  VA’s  mandatory  Transition  Assistance  Program 
(TAP),  as  well  as  information  publically  available  to  veterans  and 
employers  on  VA  and  DOL  websites.  To  understand  information 
presented  in  VA’s  TAP  program,  we  reviewed  the  facilitator’s  and 
participant’s  guides  for  the  mandatory  TAP  courses  called  Veterans 
Benefits  I  and  II,  as  well  as  a  relevant  optional  training  course  called  the 
Career  Technical  Training  Track,  and  compared  it  to  VA’s  goals  for  TAP 
after  the  VOW  to  Hire  Heroes  Act  of  201 1  was  implemented.7  We  tallied 
the  number  of  pages  in  the  facilitator’s  guides  that  mentioned  OJT  and 
apprenticeship  as  options  under  the  Post-9/11  Gl  Bill.  Similarly,  we 
reviewed  the  online  version  of  the  Veterans  Benefits  I  and  II  training  to 
see  if  additional  information  about  OJT  and  apprenticeship  options  was 
presented.  We  also  reviewed  relevant  pages  of  VA  and  DOL  websites. 

We  reviewed  and  documented  Post-9/1 1  Gl  Bill  and  related  web  pages 
using  screen  shots  of  each  relevant  page,  and  noted  key  portions  of 
content.  We  assessed  the  information  available  from  these  sources  to 
determine  if  a  veteran  or  employer  could  reasonably  understand  these 
programs,  as  described  in  the  Plain  Writing  Act  of  2010  and  Standards  for 
Internal  Control  in  the  Federal  Government.  In  both  the  TAP  and  website 
analyses,  we  reviewed  included  examples  and  exercises,  visual  symbols 
such  as  the  Post-9/11  Gl  Bill  logo,  and  the  language  used  to  describe 
Post-9/11  Gl  Bill  benefits  to  determine  how,  if  at  all,  OJT  and 
apprenticeship  options  were  included.  For  the  website  analyses  we  also 
looked  to  see  how,  if  at  all,  the  agencies  created  links  to  each  other’s 
content  and  resources.  The  calculations  and  content  analysis  of  the  TAP 
and  the  website  analyses  were  independently  reviewed  and  verified  by 
another  GAO  team  member. 


6GAO,  Standards  for  Internal  Control  in  the  Federal  Government,  GAO/AIMD-OO-21.3.1 
(Washington,  D.C.:  Nov.  1,  1999). 

7  Pub.  L.  No.  112-56,  §221,  125  Stat.711,  715-18. 
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Interviews  with  Officials 
and  Stakeholders 


To  gain  perspectives  on  how  Post-9/11  Gl  Bill  OJT  and  apprenticeship 
programs  are  serving  veterans,  we  conducted  interviews  with  a  variety  of 
federal  and  state  officials.  We  spoke  with  officials  at  the  VA  and  DOL 
concerning  program  administration,  outreach  efforts,  performance 
measurement,  and  coordination  of  their  respective  OJT  and 
apprenticeship  programs.  We  also  interviewed  officials  at  DOD  to  better 
understand  transition  services  that  are  available  for  service  members 
upon  exiting  the  military.  For  perspectives  on  Post-9/11  Gl  Bill  program 
usage  and  outreach,  we  also  interviewed  State  Approving  Agency  (SAA) 
officials  from  13  states.  We  chose  these  13  states  in  order  to  get  a  range 
in  the  number  of  active  OJT  and  apprenticeship  programs  and  geographic 
location.  We  also  chose  these  states  based  on  the  institutional  location  of 
the  SAAs,  so  as  to  gain  greater  perspective  on  program  use  and  what,  if 
any,  challenges  SAAs  observe  in  administering  the  Post-9/11  Gl  Bill.8 

We  also  interviewed  stakeholders  and  experts  to  learn  how  OJT  and 
apprenticeship  programs  are  used  and,  from  these  stakeholders’ 
perspective,  how  effectively  they  serve  veterans.  Specifically,  we 
interviewed  representatives  from  a  variety  of  veteran  service 
organizations  (VSOs)  that  serve  Post-9/11  veterans  and  were 
recommended  by  internal  and  external  experts  on  veterans  issues. 
Additionally,  we  spoke  with  workforce  experts  with  job  training  expertise 
to  understand  what,  if  any,  academic  literature  could  shed  light  on  the 
question  of  OJT  and  apprenticeship  program  effectiveness,  though  their 
views  do  not  represent  the  entire  research  field.  Subsequently,  we 
reviewed  a  2012  Mathematica  Policy  Research  study,  commissioned  by 
DOL,  which  was  cited  by  experts  we  interviewed.9  This  study  conducted  a 
cost-benefit  analysis  that  included  an  assessment  of  the  net  effects  of  the 
Registered  Apprenticeship  program  on  participant  outcomes.  As  noted, 
we  found  the  study  to  be  generally  reliable  with  some  methodological 
limitations. 


8Some  states  jointly  administer  the  higher  education  Post-9/1 1  Gl  Bill  programs  with  the 
OJT  and  apprenticeship  programs,  while  others  separate  these  functions.  Moreover, 
SAAs  for  OJT  and  apprenticeship  programs  are  housed  within  varying  agencies  across 
states. 

9Debbie  Reed  et  al.,  An  Effectiveness  Assessment  and  Cost-Benefit  Analysis  of 
Registered  Apprenticeship  in  10  States,  (Oakland,  Calif.:  Mathematica  Policy  Research, 
2012). 
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Site  Visits  Among  our  13  case  illustration  states,  we  selected  two — Missouri  and 

North  Carolina — for  site  visits  because  they  have  high  numbers  of  Post- 
9/1  1  Gl  Bill-approved  OJT  and  apprenticeship  programs,  and  different 
institutional  settings  for  their  SAAs.10  During  these  site  visits,  we 
interviewed  SAA  officials,  OJT  and  apprenticeship  employers  and 
sponsors,  veteran  participants,  and  local  workforce  officials  so  that  we 
could  get  a  wide  range  of  stakeholder  perspectives  of  Post-9/1 1  Gl  Bill 
OJT  and  apprenticeship  programs,  though  these  perspectives  do  not 
necessarily  reflect  those  of  states  more  generally.  We  also  observed 
training  programs  on  site  in  such  professions  as  communications 
technology  maintenance  and  police  work.  For  additional  context,  we  also 
conducted  interviews  at  two  local  site  visits  in  the  Washington,  D.C.  area 
that  involved  federal  programs  that  were  registered  through  the  Post-9/1 1 
Gl  Bill — the  Department  of  State’s  Bureau  of  Diplomatic  Security  OJT 
program  and  the  Department  of  Defense’s  Defense  Logistics  Agency 
Energy  OJT  program. 


i  n 

North  Carolina’s  SAA,  situated  under  the  state  department  of  commerce,  approves  only 
OJT  and  apprenticeship,  as  well  as  Registered  Apprenticeship  programs,  while  Missouri’s 
SAA  is  housed  in  the  state  department  of  education  and  approves  higher  education  as 
well  as  OJT  and  apprenticeship  programs  under  the  Gl  Bill. 
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DEPARTMENT  OF  VETERANS  AFFAIRS 
WASHINGTON  DC  20420 
October  29,  2015 


Mr.  Andrew  Sherrill 
Director,  Education  Workforce,  and 
Income  Security  Issues 
U.S.  Government  Accountability  Office 
441  G  Street,  NW 
Washington,  DC  20548 

Dear  Mr.  Sherrill: 

The  Department  of  Veterans  Affairs  (VA)  has  reviewed  the  Government 
Accountability  Office’s  (GAO)  draft  report,  “VA  BENEFITS:  Increasing  Outreach  and 
Measuring  Outcomes  Would  Improve  Post-9/11  Gl  Bill  On-the-Job  Training  and 
Apprenticeship  Programs”  (GAO-16-51).  VA  agrees  with  GAO’s  conclusions  and 
concurs  with  GAO’s  recommendations  to  the  Department. 

The  enclosure  specifically  addresses  GAO’s  recommendations,  and  provides  an 
action  plan  and  technical  comments.  VA  appreciates  the  opportunity  to  comment  on 
your  draft  report. 

A 

Sincerely,  i 


Robert  L.  Nabors  I 
Chief  of  Staff 


Enclosure 
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Enclosure 

Department  of  Veterans  Affairs  (VA)  Comments  to 
Government  Accountability  Office  (GAO)  Draft  Report 

“VA  BENEFITS:  Increasing  Outreach  and  Measuring  Outcomes  Would  Improve 
Post-9/11  Gl  Bill  On-the-Job  Training  and  Apprenticeship  Programs” 

(GAO-16-51) 

GAO  Recommendation  1:  To  help  ensure  that  veterans  are  aware  of  the  Post-9/11 
OJT  and  apprenticeship  programs  so  they  can  make  informed  decisions  about 
how  they  use  their  benefits,  the  Secretary  of  VA  should  identify  and  implement 
appropriate,  cost-effective  actions  to  increase  awareness  of  OJT  and 
apprenticeship  benefits  under  the  Post-9/11  Gl  Bill. 

VA  Comment:  Concur.  The  Veterans  Benefits  Administration  (VBA)  will  develop  a 
“Guide  to  VA  Benefits  for  On-the-Job  Training  (OJT)  and  Apprenticeship  Training  for 
Employers  and  Sponsors.”  The  guide  will  be  publicized  and  available  for  viewing  and 
download  on  the  Gl  Bill® website,  in  addition,  information  on  OJT  and  apprenticeship 
benefits  will  be  provided  to  Veterans  and  interested  stakeholders  via  an  email  blast  and 
posted  to  the  Employers  page  of  the  Employment  Center  section  on  the  eBenefits 
website.  Target  Completion  Date:  June  1,2016. 

Recommendation  2:  To  help  address  challenges  veterans  and  employers 
reported  facing  in  using  the  OJT  and  apprenticeship  programs,  the  Secretary  of 
VA  should  identify  and  implement  cost-effective  steps  to  ease  administrative 
challenges  in  submitting  paperwork  or  receiving  payments  as  the  new  automated 
VA-CERTS  system  to  process  program  approvals  and  benefit  payments  is  being 
developed  and  implemented. 

VA  Comment:  Concur.  VBA  will  explore  the  feasibility  of  cost-effective  options  and  will 
develop  a  plan  to  ease  the  administrative  challenges  for  employers  and  Veterans  to 
submit  paperwork  and  receive  payments  until  the  new  automated  VA-CERTS  is  in 
place.  Target  Completion  Date:  June  1,2016. 

Recommendation  3:  To  increase  accountability  for  program  performance,  the 
Secretary  of  VA  should  establish  measures  to  report  on  program  outcomes  for 
Post-9/11  Gl  Bill  OJT  and  apprenticeship  programs,  including  considering 
relevant  data  sources  and  seeking  legislative  authority  to  gain  access  to  data  if 
necessary. 

VA  Comment:  Concur.  The  Department  of  Veterans  Affairs  (VA)  agrees  that  program 
performance  metrics  should  be  developed  to  report  on  program  outcomes.  Over  the 
past  three  years,  VA  has  actively  collaborated  with  the  Department  of  Education  (ED) 
and  the  Department  of  Defense  (DoD)  to  establish  outcome  measures  for  the  Post-9/1 1 
Gl  Bill  in  accordance  with  Executive  Order  13607  (Establishing  Principles  of  Excellence) 
and  Public  Law  112-249  (Comprehensive  Policy  on  Providing  Education  Information  to 
Veterans).  VA  published  initial  outcome  measures  on  graduation,  retention, 
persistence,  and  transfer-out  rates  on  the  Gl  Bill  website.  VA,  in  collaboration  with  DoD 
and  ED,  is  currently  exploring  the  collection  of  post-graduation  data  related  to 
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Department  of  Veterans  Affairs  (VA)  Comments  to 
Government  Accountability  Office  (GAO)  Draft  Report 

“VA  BENEFITS:  Increasing  Outreach  and  Measuring  Outcomes  Would  Improve 
Post-9/11  Gl  Bill  On-the-Job  Training  and  Apprenticeship  Programs” 

(GAO-16-51) 

employment  rates  and  average  salary  for  graduates.  VA  will  work  to  develop  a  plan  to 
determine  the  feasibility  of  collecting  and  publishing  this  data  for  OJT  and 
apprenticeship  programs.  Target  Completion  Date:  June  1, 2016. 
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Andrew  Sherrill,  (202)  512-7215  or  sherrilla@gao.gov 
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GAO’s  Mission 

The  Government  Accountability  Office,  the  audit,  evaluation,  and 
investigative  arm  of  Congress,  exists  to  support  Congress  in  meeting  its 
constitutional  responsibilities  and  to  help  improve  the  performance  and 
accountability  of  the  federal  government  for  the  American  people.  GAO 
examines  the  use  of  public  funds;  evaluates  federal  programs  and 
policies;  and  provides  analyses,  recommendations,  and  other  assistance 
to  help  Congress  make  informed  oversight,  policy,  and  funding  decisions. 
GAO’s  commitment  to  good  government  is  reflected  in  its  core  values  of 
accountability,  integrity,  and  reliability. 

Obtaining  Copies  of 
GAO  Reports  and 
Testimony 

The  fastest  and  easiest  way  to  obtain  copies  of  GAO  documents  at  no 
cost  is  through  GAO’s  website  (http://www.gao.gov).  Each  weekday 
afternoon,  GAO  posts  on  its  website  newly  released  reports,  testimony, 
and  correspondence.  To  have  GAO  e-mail  you  a  list  of  newly  posted 
products,  go  to  http://www.gao.gov  and  select  “E-mail  Updates.” 

Order  by  Phone 

The  price  of  each  GAO  publication  reflects  GAO’s  actual  cost  of 
production  and  distribution  and  depends  on  the  number  of  pages  in  the 
publication  and  whether  the  publication  is  printed  in  color  or  black  and 
white.  Pricing  and  ordering  information  is  posted  on  GAO’s  website, 
http://www.gao.gov/ordering.htm. 

Place  orders  by  calling  (202)  512-6000,  toll  free  (866)  801-7077,  or 

TDD  (202)  512-2537. 

Orders  may  be  paid  for  using  American  Express,  Discover  Card, 
MasterCard,  Visa,  check,  or  money  order.  Call  for  additional  information. 

Connect  with  GAO 

Connect  with  GAO  on  Facebook,  Flickr,  Twitter,  and  YouTube. 

Subscribe  to  our  RSS  Feeds  or  E-mail  Updates. 

Listen  to  our  Podcasts  and  read  The  Watchblog. 

Visit  GAO  on  the  web  at  www.gao.gov. 

To  Report  Fraud, 
Waste,  and  Abuse  in 
Federal  Programs 

Contact: 

Website:  http://www.gao.gov/fraudnet/fraudnet.htm 

E-mail:  fraudnet@gao.gov 

Automated  answering  system:  (800)  424-5454  or  (202)  512-7470 

Congressional 

Relations 

Katherine  Siggerud,  Managing  Director,  siggerudk@gao.gov,  (202)  512- 
4400,  U.S.  Government  Accountability  Office,  441  G  Street  NW,  Room 
7125,  Washington,  DC  20548 

Public  Affairs 

Chuck  Young,  Managing  Director,  youngd@gao.gov,  (202)  512-4800 

U.S.  Government  Accountability  Office,  441  G  Street  NW,  Room  7149 
Washington,  DC  20548 
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